Is anyone else experiencing this with the API/playground in GPT-4o? This happened when I tried switching languages. In the playground it gave me a full block of random garbage around 4000 tokens long, in the API it outputted something similar, then threw an API error. The temperature is 1.5, which worked in GPT-4 so I’m wondering if the way temperature works has changed or if this is a bug?
That’s not an usual behavior for that high of a temperature. I suggest you lower it to 1 or below 1 for improved outputs. Even for other models I have seen this type of behaviour with such temperature values.
1 Like