429 Rate Limit error while using Azure Open AI

API
1

I wanted to check if anyone has faced this issue with Azure Open AI. I was doing some embeddings and suddenly started getting 429 errors. I was not hitting the API hard, the requests were minimal. So, it seems that the rate limiting probably is not at the user level, it may be at all user(who are using the service) level.

Just thought to check if anyone can confirm this. For now, I implemented an exponential back-off to address this, but for the limited number of requests, I should not have got 429

2

I’ve seen a couple of similar topics already. You’re not alone. =)

3

There are two limites: One is for your own usage, in tokens-per-minute, and one is for everybodys usage.
You will get rate limited if you either exceed your own burst limit, OR if the system itself is overloaded.