Summary created by AI.
The thread begins with oguzhan experience an error with the OpenAI’s pay-as-you-go service. An error persistently occurs when they use the model “text-davinci-003”. rankoneads argues that everyone is dealing with a similar issue and the OpenAI team hasn’t responded for about 72 hours.
However, ruby_coder suggests that the issue is not universal, as they have three active OpenAI API applications and none of them are producing errors. rankoneads, adamant, mentions that even with a 5-second delay, around 30-50% of their outputs still create an error.
Further attesting to the persisting errors, wunderbaba mentions a previously unflawed program has started to consistently return errors. They hypothesize that it’s due to davinci-003 and ChatGPT sharing compute space but aren’t certain.
The issue remains unresolved, with rankoneads repeating that everyone is experiencing the same error for about 72 hours without inputs from the supporting team. ruby_coder guesses the reason might be due to adding 100 million users since December 2023, which has caused strain on the infrastructure.
Additionally, OpenAI’s method of balancing the number of requests from different regions (possibly via “geo-based throttling”) could be causing these disruptions. However, ruby_coder is only speculating and has no way of confirming this.
Some users have found workarounds, like rankoneads who adds about 10 retries to the curl function, and admits roughly 3-4 out of the 10 attempts fail. But the complaint remains the same, with users such as tariqayesha037, marisham1223, jeovonniip and mshahid, all stating they have the same error.
In a more alarming report, maneesh states that the OpenAI server is throwing a 500 error for a paid account, making it hard to trust the API service. They also note OpenAI is providing an overloaded error message after only 2 or 3 requests.
Eventually, Quentin_Beillard confirms OpenAI is aware and investigating the ongoing error, shares an error message similar to other users, and promises to provide updates as the situation evolves.
Summarized with AI on Nov 24 2023
AI used: gpt-4-32k