I’ve been noticing a lot of 503/500 errors also. I might be crazy but changing the “name” field on my request will toggle between a successful and error response.
Error 503:
{
"model": "gpt-3.5-turbo",
"messages": [
{
"role": "user",
"content": "Hi."
}
],
"max_tokens": 800,
"temperature": 0.8,
"frequency_penalty": 0,
"user": "lVJjDMAsYk5uo9seH7zmC4WJe933"
}
Successful (I’ve deleted the last character “3” on the “name”)
{
"model": "gpt-3.5-turbo",
"messages": [
{
"role": "user",
"content": "Hi."
}
],
"max_tokens": 800,
"temperature": 0.8,
"frequency_penalty": 0,
"user": "lVJjDMAsYk5uo9seH7zmC4WJe93"
}