I make a lot of daily API calls, and have never had this problem except when I pulled 100s of text strings out of a DB and sent them to the embeddings API without a delay in the loop! That broken things fast, after a few iterations.
However, for all “normal” (not in a fast loop) API call, I have never had this issue, ever.
My best guess is that there is some “strangeness” going on with Cloudflare, based on some access / rate limiting criteria we are not aware of. It is also possible that OpenAI has been so busy that the have not updated their "work flow " to update Cloudflare rate limiting on a “per user” basis. However, I “think” (from all the posts here) the issue resides in Cloudflare.
You can see from this Cloudflare doc, that every user would have to match a criteria and the Cloudflare rate limiting rule updated / created:
I’m not a Cloudflare person (or a big fan of Cloudflare, TBH), but it does not seem “trivial” to set up Cloudflare on a “per user” basis based on a OpenAI plan which is outside of the Cloudflare ecosystem.
It could easily be possible that the OpenAI staff is not aware of what must happen on the Clouldflare end of things to support their new paid plans?
I am have been seeing this issue for the past 12 hrs. I am a free account, but was considering moving to a paid account. I’ll be waiting to pay until I can at least see a request go through!
Someone above stated earlier that had success when changing models. Unfortunately, I see the same behavior regardless of using 001, 002, or 003.
Same issue here. Pay as you go, old account… should have 3,000 requests / minute as limit. Yet, keep receiving 429 - too many requests error, after only a couple of dozen requests in a row
You can add a test condition to your code and when the API is overloaded and fails, you can wait a few “random” seconds and resubmit.
It’s just a few lines of code. Of course, you will need to parse the API error messages and make sure it is a type of “overloading” issue, testing it, etc.
Maybe on every retry send an email to OpenAI support. Complaining haha
I implemented retry logic in my code with a random time out and varied the davinci model, but still getting the too many requests. are you a paid account?
Similar issue here. Any requests through the API gives the same 429 error. Even sending a single request with the API playground gives the ‘You’ve reached your usage limit.’ error. I have a paid account, and am not even close to the usage limit. I tried creating a second account with a new email, credit card and phone number and got the same error.
If you search the forum (the big magnifying glass icon on the top right of every page), you will see that this topic has been discussed to death already:
Ok. It looks as though we are never going to get a response from support. I’m sure they are overwhelmed, but this issue is very pervasive. So I have some questions if anyone would be willing to answer:
How long have you been using the API?
During that time frame were you ever successful getting a completion to work?
If yes, when did it stop working for you?
When sending requests today, for your particular account, are any requests getting through or none?
Which model(s) are you having difficulty with (Please list models and their success/failure stats)?
Are you a free account or paid account?
If paid, which account type did you sign up for?
Perhaps if each user lists their specific issues, when a support resource is able to look at the stats they will be able to more easily isolate the issue.
My answers:
I have been attempting to use the API for about 1 month.
I have never been successful getting a completion through with nextjs code or Postman. I’ve changed models, retry logic, new tokens, upgraded to a paid account and have never received a 200 for a completion request
Sometimes its running, sometimes it fails
but I guess it will have to do for now.