I’m using OpenAI’s API with the following settings: • temperature=0 • top_p=0 From my understanding, setting the temperature and top p to 0 should make the outputs deterministic, meaning it should always return the same result given the same input. However, I am still observing some randomness…

Why does OpenAI API behave randomly with temperature 0 and top_p 0?

shure.alpha September 11, 2024, 9:49am 3

@Foxalabs
Thank you for your reply
I found this

Topic		Replies	Views
Run same query many times - different results API	11	8545	December 21, 2023
Why the API output is inconsistent even after the temperature is set to 0 API gpt-4	11	25468	December 21, 2023
Why is GPT-4 giving different answers with same prompt & temperature=0? API	6	17158	April 6, 2023
Achieving deterministic API output on language models - HOWTO API statistics	3	9639	December 21, 2023
GPT-4 API result not stable with temp 0 API gpt-4	1	1828	July 17, 2023