I’ve also been getting
Request failed with status code 502 errors in the past 10 hours. BTW openai api takes several minutes before throwing an error and timing out, which is a bit annoying.
I’ve also been getting
You can write code in your app to shorten this timeout.
Normally, this is a good time to work on error and exception handling code when performance is bad.
For example, check out this current topic:
Makes sense. I just set a 30 seconds timeout and then I try with gpt-3.5-turbo-0301. Not sure if changing the model will make any improvement though
having 3 + days of failed requests because of timeouts is pretty bad for a business
same error to me, what is the solution?
It does. Sometimes, outages do not work the same way for all the models/endpoints (sometimes they do).
@ljia31523 All the strategies are pretty much explained in this link that @ruby_coder already shared. Feel free to reach out if you still have doubts or do not know how to implement them.
Same problem with davinci-003 and 3.5-turbo
Experiencing the same issue with both davinci-003 and davinci-002.
It’s almost been 3 days with the same issue. It’s making it really hard to work.
what is most annoying to me is:
I try to set a timeout at
openai.ChatCompletion.create(..., timeout=10) hoping that that after 10seconds, if it is still “hunging”, please stop.
I am using
@retry(wait = wait_random_exponential(min =1, max = 60), stop = stop_after_attempt(6)) def chatcompletion_with_backoff(**kwargs): to hope to handle this.
HOWEVER, there are no “timeout”. I have been monitoring the process. There are mulititimes that the the request being going on >minutes, and yet no Timeout is thrown out.
See this for the similar complaints…
I mean, basic coding principle, things should “do what they say, say what they do”… it’s clearly not the case here.
any guidance pls? Just keep “trying” and wait for things to clear, unfortunately is not an option
Exactly, does not give me the confidence to roll my app functionality out to further users at all, unless things get a bit more stable.
I’ve faced the same timeout issue. In the Python API, if you pass the parameter
openai.ChatCompletion.create instead of
timeout then it will throw a
Timeout exception after n seconds. Hope it helps
But yes, I’ve been facing these issues as well…
We have exactly the same problem with timeouts.
thank you for pointing out the
same here! I plan to use claude to see if it is more stable
thanks, I have try catch and add timeout in my code. The api may be stable today.
Probably is intermittent. If it times out continuously more than a certain amount of time it would change to something else.
Yeah, I hear you.
I’m been working for about an hour and it TIMEOUT about 70% of the time or so…
Timeouts started increasing around 1am Sunday and continued through Monday. Back to normal today. Here’s a graph of the increase. The blue line is timeout errors.
Is it working with retry decorator?
result = openai.ChatCompletion.create within a ThreadPoolExecutor. Try and catch
future.result(10). When ThreadPoolTimeoutError is raised, use tenacity to retry on this exception