openai.error.ServiceUnavailableError: The server is overloaded or not ready yet

API
22

Hi,

with the new openai API 1.2, this does not seem to work, I tried

@retry(wait=wait_random_exponential(min=1, max=120), stop=(stop_after_delay(60) | stop_after_attempt(6)),
retry=retry_if_exception_type((APIError,APIConnectionError,RateLimitError,APIStatusError,Timeout)))
def chat_completion_with_backoff(azure_openai_client = None, **kwargs):
    return azure_openai_client.chat.completions.create(**kwargs)

I think the problem are the types of open ai errors which I imported with

from openai import AzureOpenAI # see new API format in https://github.com/openai/openai-python/issues/740
from openai import APIError
from openai import APIConnectionError
from openai import RateLimitError
from openai import APIStatusError
from openai import Timeout

It does not seem to retry at all… Any ideas?

Thanks

Eurico