Today we have started seeing intermittent timeouts with gpt-4-1106-preview. Sometimes response is immediate, sometimes it hangs and times out in 10 minutes. New requests could be resolved while the older ones are still hanging (and eventually timeout).
I’d like to confirm that other customers are experiencing the same thing.
In case devs are monitoring this forum – maybe there is some kind of queue
or balancing errors? I’d appreciate the response.
Hi and welcome to the Developer Forum!
This does indeed seem to be an issue that some are facing, probably due to load and hopefully this will get resolved with more hardware and possible code refinements as hinted at by OpenAI’s Greg Brockman today on Twitter.
same problem. It return “504 gateway time out” ,when I use the GPT-4 API not only preview. And sometime, the GPT-3.5 API also time out, it make me mad!
Do we have any solution for this issue yet? I am getting the same 504 gateway timeout error!