My team and I have tried using OpenAI API (GPT-3.5 and Whisper) for weeks now, but the latency is high, sometimes we have to wait for a while to receive one response.
My question is that if we pay for a pay-as-you-go account if there any improvements in the:
- The speed
- the number of models available
I can only see the detail about rate limit in the documentation.