Async API random garbage text with gpt-4-turbo, but not gpt-4o or gpt-3.5-turbo

I am seeing random garbage text appearing in responses from the async API with gpt-4-turbo but not gpt-4o or gpt-3.5-turbo Curious if anyone else is seeing something similar.

1 Like

I’m also experiencing this. I haven’t confirmed that gpt4 and gpt4turbo work, but I’ve definitely observed this with gpt4o

Edit: Considering that the generated HTTP requests are identical (both for v0 and v1, async and sync), it doesn’t seem like the request itself can be causally involved.

I get gibberish output at a really low rate (default temp). The odds of seeing it may go up with how often I’m querying, so using an async client to fire off 20 queries at once could be involved.