Model Performance Degradation

There is a significant decline in the model’s performance on o1-Pro account.

The model’s response time has drastically shortened (from ~5 minutes to just a few seconds);
The accuracy of answers has notably decreased;
The same queries that received correct answers two weeks ago are now receiving incorrect responses.

3 Likes

I have a similar problem!
The $200 model gives 100 times worse answers than the 4o, and
I’ve been having this problem for two days,
I am also limited in the number of lines I can send, experimentally I determined that ~600 lines can be sent, and on Thursday everything was fine!

This issue has been around for a long time, and the performance suddenly degrades without warning, sometimes even resulting in a downgrade of the model. I’ve experienced this several times, where it seemed like the model was downgraded from o1 to o1 mini, or 4o to 4o mini. It also lasts for a long time, and I wouldn’t be surprised if the model stays in this unusable state for half the month, every month.

My Plus account is currently also experiencing a significant drop in model quality. The responses are basically unreliable now. The o1 model only occasionally triggers longer thinking times (30 seconds to 2 minutes), but most of the time it’s under 2 seconds with only 1 or 2 steps of reasoning.

From past experience, this kind of problem usually happens when OpenAI is doing internal upgrades or tests, but they’re always testing new things. I suspect OpenAI is deliberately reducing the compute power available to users for their own testing. It feels like users didn’t actually pay for a service or product, but are just funding GPT’s iterations, and ChatGPT is just a toy that OpenAI tosses to us. It’s really frustrating.

3 Likes

any news about this? I am starting a loop with 4o-mini which is about 1 sec per iteration and over time it slows time to about 25 (!) sec per iteration. The context length is about 100 tokens and does NOT grow over time.
What could be the reason?

internet acess also are gone i cannot uses web in 4o and i actually dont know for what i pay my 24 euro for their experiments? but i dont want be a subject and i hope that they fix it in several month and if not than i cancel my subscribtion