Hi there, I am interested in using the API at scale and I have some questions around that topic. I am aware of the rate limits found here: Is API usage subject to any rate limits? | OpenAI Help Center My question is: For my API token, are there limits around the number of simultaneous requests I c…

Hello, Have you found an answer ? I am also wondering about simultaneous requests Thanks!

@youri.rd Thanks for finding this answer!

@cabo @youri.rd , it looks like there is indeed no limitation on simultaneous requests. However, it is not clear to me how to keep track of what response belongs to what request as there doesn’t seem to be a way to attach a unique identifier to a request. Any thoughts or suggestions on how to addre…

@vleu Probably be good to start a new topic describing your issue and what technology you are using. Most usage waits for response to come back (or stream to finish).

Simultaneous Request Limitations

API

youri.rd February 11, 2023, 10:28am 3

Hi @cabo ,
It seems there s no limitation : Simultaneous Requests - API

Topic		Replies	Views
Simultaneous Requests - API API	6	5483	February 26, 2026
Using multiple keys to avoid request queuing API	3	1878	December 22, 2023
Queries about generating multiple requests at a time on davinci model and increasing the token limit API	2	2955	December 22, 2023
Gpt-3.5 concurrent requests limit API	3	6360	February 2, 2024
Multiple Apps with Separate API Keys Under One OpenAI Account: Rate Limits and Usage Tracking API api	4	734	February 18, 2025

Simultaneous Request Limitations

Related topics