Rate limit exceeded error - Azure Assistants

I am new to Azure. I created a new account on Azure, created a resource, and deployed a gpt-4o-mini model.

When I said hi in the Assistants playground, I encountered an error saying “rate_limit_exceeded: Rate limit is exceeded”. Not sure why it gave me that when I haven’t used anything yet. The Chat playground worked fine for me though.

Any thoughts or suggestions are welcome!

You have to assign a rate limit to your deployment.

There should be a slider to select how many TPM (token per minute) the deployment should be able to produce.

1 Like

That’s what confused me. I have set it to the maximum.

Do you remember the steps you had to take to create the azure account?
From registration to deployment?

I have the same problem, idk what’s wrong. All TPM are set it to the maximum

The thing is that this has close to nothing to do with OpenAI and this community.
Might be that someone knows something because we had the same problem and solved it. But I don’t think anyoen from Azure is reading this and thinks “omg, I have to look into this”.
Better ask the support of Azure. It is a completly different company.

They just happen to have an arrangement with OpenAI so they can host their models. Most probably because Microssoft invested a couple billions into OpenAI.

Could be anything from problems with billings, to you living in a country that Azure does not allow access to OpenAI models for political reasons or you just didn’t use the right configuration or and that is also possible it is a bug on Azures side.

It took me quiet a while to figure out how to deploy the models and how to handle rate limits…

Have you tried making a simple curl request?

Azure AI Foundry << can you use this chat in the playground?

HOW DO YOU PAY THE CREDITS? MY PROBLEM WAS THAT, THE PAYMENT METHOD

I really wonder how the thought process behind your question is.

I really wanted to just paste a link to google here for you. Then I saw the start page of it and how it has changed and I thought… “damn it’s been a long time since I visited that.”

So… do it like I do it:

https://chatgpt.com/