Frequent API timeout errors recently

[ruby_coder]

@emipc

BTW openai api takes several minutes before throwing an error and timing out, which is a bit annoying.

You can write code in your app to shorten this timeout.

Normally, this is a good time to work on error and exception handling code when performance is bad.

For example, check out this current topic:

Configuring timeout for ChatCompletion Python

I, like many of the rest of us, are running into the random 600s read_timeout error with the ChatCompletions api using gpt-3.5-turbo. I have looked through the python code and see that there is a timeout parameter that doesn’t seem to be documented in the api docs. I have tried setting this timeout and while it is accepted by OpenAI without error it does not seem to have an effect. The timeout still occurs at 600s when most of my requests take between 2 and 5 sec. Has anyone come up with a…