We asking API and we have 30s delay in answer. Is it normal or something is wrong? Everything was OK till today
1 Like
Hi @dyzmas2021,
you can check if there are outages OpenAI Status here.
But you are not the only one with this issue ( Variable Response Times on API gpt-3.5-turbo - General API discussion - OpenAI API Community Forum)
I’m going to start monitoring the 3.5 Turbo response times across the server and when there are too many “curl_setopt($curl, CURLOPT_TIMEOUT, 30);” timeouts, I’ll revert to Davinci 003. or GPT4. It will be interesting to see how I can switch/convert the Turbo chat style resprequests into the completion style.
1 Like
I am having random timeouts on 3.5 (tolerance is 20 sec).
On 4 sometimes it even takes a minute to respond. Same prompt in 3.5 takes seconds.