Yes there are API issues since some hour at least with GPT-4o-mini. We have a project running with multiple requests per minute. Many just won’t get a response or get fulfilled. So there seems to be instabilities. In OpenAI Status there is also something highlighted: https://status.openai.com/ but not specifically to this issue.
I’m using batch processing with apiconcurrency: 20. need to manually check every hour here and there. today had to start again 3 times already. sometimes also had to delete parts as it just left out certain batches and continued elsewhere. not sure what is going on. how is it for you?
gpt-4o via batch, none of the jobs are leaving “validating” stage. I have opened a thread with support and will update both threads when I have any hard info.
I’m running constantly batches 24/7 - the issues remain.
I also looked up status pages. Nothing to see there. I could see that there is a dependency on output token. Batches with low volume of output token had no issues, while higher output token volumes got hiccups and needed manual restart of batches.
Seems a very specific problem with the API use of 4o-mini imho.