OpenAI models are non-deterministic, meaning that identical inputs can yield different outputs. Setting temperature to 0 will make the outputs mostly deterministic, but a small amount of variability may remain due to GPU floating point math.
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Why does the answer vary for the same question asked multiple times | 8 | 4367 | May 22, 2024 | |
| Why the API output is inconsistent even after the temperature is set to 0 | 10 | 26865 | August 26, 2023 | |
| Inconsistent Responses from the Same Prompt Is This Expected? | 2 | 377 | December 27, 2025 | |
| Observing discrepancy in completions with temperature = 0 | 8 | 18712 | September 20, 2023 | |
| Why is GPT-4 giving different answers with same prompt & temperature=0? | 6 | 17765 | April 6, 2023 |