RateLimitError: The server had an error with no reason given

API Feedback
19

I have been recently receiving the same error for text-davinci-003 so did a few test. Happy to provide trace logs if OAI team need / want.

According to the latest docs the rate limit for paid account after 48 hours:

  • 3,000 requests / minute
  • 250,000 davinci tokens / minute (and proportionally more for smaller models)

However, I am able to trigger a 429 error with close to 98% reliability by sending 3 or more concurrent requests to the API. It seems that regardless of the size of the requests as soon as 3 (sometimes 4) are being processed in parallel using the same API key the service locks up. So far Iā€™ve tried it with the python SDK, Java and manually using CURL.

Ill continue testing with non parallel request.

1 Like
20

I have been getting the same error. Switching to text-davinci-002 makes it works normally.
I think there is some issue with text-davinci-003 model only.

21

I encountered this error with text-davinci-003 too. My usage is far lower than the rate limit.

22

For me I threw a time.sleep(3) in there so I do only 20 requests per minute max. The API limits are somewhere in the documentation, I think itā€™s 3k calls per minute if you have a credit card linked.

1 Like
23

I use a two second delay and it works good, but three seconds is even better if you are not in a hurry :slight_smile:

Thanks for being a good ā€œAPI Netizenā€ and not hammering on the Beta API too much :slight_smile:

1 Like
24

The error was resolved, and as noted, it had nothing to do with delays :).

26

Thatā€™s a different error than the one being discussed here.

27

Yep, thats fair enough! Just thought it might be related. :slight_smile:

28

Is this resolved for you?
Also having the same problem today.

29

Yep, itā€™s back with a vengeance this morning. Some requests needing 15-18 retries.

1 Like
30

Nasty issue indeed. Hereā€™s the way I try to mitigate it. Even if it should be fixedā€¦

31

same, does someone know a channel where we can ping the staff

32 
support@openai.com
33

Just encountered the same problem on a ā€œpay-as-you-goā€ plan. I definitely didnā€™t hit any of the specified limits. Will try to contact the support.

34

Just had the same issue: [ERROR] RateLimitError: The server had an error while processing your request. Sorry about that!

35

Iā€™m having the same error, and even though my keys are paid, Iā€™m getting these random errors with the gpt models.

1 Like
36

Itā€™s happening again. Now with the latest GPT-4 model.

37

Iā€™ve encountered the same error with GPT4

1 Like
38

Itā€™s happening now with GPT4. Canā€™t have complex interactions with it for long

39

Rate limits can happen when the API is overloaded

It doesnā€™t actually mean it has hit ā€œyourā€ rate limit. The message returned in the response is slightly different too

1 Like