I wonder if anyone knows why we get different results when running the same prompt multiple times in a row. I have noticed in quite a lot of my experiments that if you set a cool-down time in between each run, the results tend to be consistent again. In all of these runs, I have set the temperature…

OpenAI models are non-deterministic, meaning that identical inputs can yield different outputs. Setting temperature to 0 will make the outputs mostly deterministic, but a small amount of variability may remain due to GPU floating point math.

Run same query many times - different results

API

Foxalabs July 21, 2023, 6:17pm 4

Welcome to the forum!

It is very deterministic, but you may see some variation over hundreds of runs.

2 Likes

Topic		Replies	Views
Why does the answer vary for the same question asked multiple times Community api	8	2439	May 22, 2024
Why is GPT-4 giving different answers with same prompt & temperature=0? API	6	16549	April 6, 2023
Observing discrepancy in completions with temperature = 0 API	9	17567	February 6, 2024
Why the API output is inconsistent even after the temperature is set to 0 API gpt-4	11	23762	December 21, 2023
Ensuring Consistent Output with GPT-4o-2024-08-06 (Temperature Set to 0) Prompting gpt-4 , api	4	893	November 7, 2024

Run same query many times - different results

Related topics