I am seeing random garbage text appearing in responses from the async API with gpt-4-turbo
but not gpt-4o
or gpt-3.5-turbo
Curious if anyone else is seeing something similar.
2 Likes
I’m also experiencing this. I haven’t confirmed that gpt4 and gpt4turbo work, but I’ve definitely observed this with gpt4o
Edit: Considering that the generated HTTP requests are identical (both for v0 and v1, async and sync), it doesn’t seem like the request itself can be causally involved.
I get gibberish output at a really low rate (default temp). The odds of seeing it may go up with how often I’m querying, so using an async client to fire off 20 queries at once could be involved.
I started experiencing this significantly since yesterday.