I am getting token with logprobs = -9999.0, which means the token is extremely unlikely. This happens when I set temperature to 0 as well, which shouldn’t be possible.
This is only happening only with “gpt-4o-2024-08-06”. “gpt-4o-2024-11-20” seems to be working fine.
logprobs for gpt-4o-2024-08-06 seems to be completely off today. I encountered a similar issue. For some tokens, it even directly copies the top probs from its previous token. “gpt-4o-2024-11-20” is working fine on my side too
1 Like
Today, we’re also seeing issues with gpt-4o-2024-08-06 returning values of -9999.0 for situations that previously had normal values.
Hi guys, welcome to the community!
Are you guys also interested experiencing quality degradation?
OpenAI seems to have been struggling with 08-06 for about a week now. I wonder if it’s connected to the ongoing issues we dealt with here Gpt-4o-2024-08-06 changed behavior? - #4 by sps
Is changing over to a different version an option for you?
2 Likes
Thanks for sharing, seems like there are a few issues related to the 08-06 model that is leading to quality degradation and behavior changes. Ideally we can use the same version for more consistent output, as we need time to test the newer release models before putting them into production.
Happened a few weeks ago…