Possible bug? gpt-3.5-turbo non-deterministic even with temperature zero

Temperature 0 makes it more deterministic but it is still drawing from a pool of tokens and some randomness will always come into play. Unless you prompt it very specifically, you can always expect the results to be a bit different some times.

3 Likes