My entire app is down. We started getting these errors out of nowhere. Nothing works!
“error”: {
“message”: “The server had an error while processing your request. Sorry about that!”,
“type”: “server_error”,
“param”: null,
“code”: null
EDITED:
Now i’m receiving the following error:
AgentFollowUpWorkflow: {
“error”: {
“message”: “Your request rate has increased suddenly, overloading the model. Please reduce your request rate to its original level, keep it stable for at least 15 minutes, and then gradually increase it. If the error persists, please contact us through our help center at help.openai.com.”,
“type”: “slow_down”,
“param”: null,
“code”: “slow_down”
}
}
Note I’m literally not doing absolutely any requests.
Same here:
0|ai-dmx | type: ‘error’,
0|ai-dmx | sequence_number: 2,
0|ai-dmx | error: {
0|ai-dmx | type: ‘slow_down’,
0|ai-dmx | code: ‘slow_down’,
0|ai-dmx | message: ‘Your request rate has increased suddenly, overloading the model. Please reduce your request rate to its original level, keep it stable for at least 15 minutes, and then gradually increase it. If the error persists, please contact us through our help center at help.openai.com.’,
0|ai-dmx | param: null
0|ai-dmx | }
0|ai-dmx | }
The error itself is the behavior of the priority tier SLA that is a substitute for prepurchased tiered pricing of compute units. Those requests that grow faster than provisioning should fall back to a normal request instead of you getting no service. Quite odd.
It’s wise not to rely solely on OpenAI. You could back it up with Azure or AWS, or even integrate another model provider entirely. Service outages can happen not just with OpenAI, but with any provider. Having a fallback ensures you get a response from somewhere rather than no response at all!