Parallelise calls to the API - is it possible and how?

Hi,
I have a task for which I need to call the completions API several thousand times and expect this to take several hours.

I don’t need help with optimising the prompt itself, but to understand what’s the most recommended way to parallelise (if this is allowed) the calls to the API so that the task completes a little faster.

Also, could anyone confirm if there is a limit to the number of concurrent calls? Some information I’ve found on the internet suggests that only up to two concurrent requests are possible.

Any other solution that could help complete the task faster with respect to making the API requests would be appreciated. Thanks!

1 Like

Hey, welcome to the forum.

There’s no way to send multiple calls at the same time, as far as I know.

There’s also rate limits in place.

https://help.openai.com/en/articles/5955598-is-api-usage-subject-to-any-rate-limits

If you need to access more frequently, I would reach out to OpenAI chat support and ask…

https://help.openai.com/en/

Hope this helps!