Obligatory +1. I’ve implemented exponential backoff, but subsequent retries still hang. Often, my entire retry limit is exhausted with no response with the ChatCompletions API with gpt-3.5-turbo.
2 Likes
Obligatory +1. I’ve implemented exponential backoff, but subsequent retries still hang. Often, my entire retry limit is exhausted with no response with the ChatCompletions API with gpt-3.5-turbo.