Why does chat GPT give alternating results for example in one chat window if I give a question with two options and I asked the same question multiple times, the first window shows all results of one single option but in a new chat window if i ask the same question by reversing the options and ask it multiple times it starts giving me alternating results ie first answer option 1 and then option 2 then option 1 and then option 2 again
Hey there and welcome to the community!
As you’re discovering, there is quite a lot of variability in model responses. Because these systems are built to handle all different kinds of questions, even if you ask it the same question verbatim, it will generally produce a slightly different result. That’s what these systems are meant to do; help answer questions (or do particular tasks) that requires a little bit of flexibility, creativity, or some kind of “fuzziness”.
A good rule of thumb, if you are looking for a particular degree of consistency, is “What pattern do I want it to follow? How can I describe this pattern I want in a very clear, detailed way?”
1 Like