With people moving instructions that used to be formulated in code into prompts and so prompts becoming parts of computer programs I was wondering: is that stable? can I rely on a prompt to deliver the same answer at any time?
No, not reliably. You’ll run into instances where the same prompt can give two different outputs. Setting temperature to 0 might help though.
2 Likes
Take a look at using microservices, AKA baby bots (my words, lol) to help with the deterministic problem. Mike @ openai did a very informative post on this topic recently.
https://help.openai.com/en/articles/5528730-fine-tuning-a-classifier-to-improve-truthfulness
2 Likes