Is there a secret "soft cap" or shadowban on o1 pro that we aren't told about? Consistent faster/dumber performance toward the end of the week

ChatGPT
1

About two weeks ago, even when the model “thinks” for the proper amount of time, I noticed that it would go off the rails and make tons of mistakes. I narrowed this down to likely be a context window issue, and I suspected they lowered the context window. I could still get somewhat intelligent code refactoring if I kept the context window light in the beginning.

I noticed as well that it spontaneously just got dumber around Friday, conveniently after I had been using it all week at work.

Now I log on, on a Saturday, on a different device than I normally do, and GPT won’t think at all, it lies and tells me its using o1 pro but it is clearly mimicing the thought style and speed of o3 mini. Yet I can get on my phone on the app, and it seems to think and behave like it is supposed to.

Is there a soft cap we aren’t told about? Are we getting shadowbanned for suspected account sharing when we log on to new devices?

EDIT: The “lying” about using pro issue seemed to be isolated to using icognito mode to log in, when I log in without incognito mode it works properly, but still unknown on whether I am still rate limited based on my usage earlier in the week (or if the entire model is just dumber).

2

Yes, I think so. Account sharing can also result in losing your account. Additionally, I would say it is technically impossible to hide that from OpenAI. If you notice that responses are getting slower, consider it a warning.

just kidding… I have no idea. But I don’t think that is the case.

Maybe on a Saturday more people use it and they have to do some tricks.
Sampling parameters, as well as quantization and model compression, could be used to manage load spikes - which could lead to lower reponse quality…

But like I said I have no idea.

3

That doesn’t mean you are in incognito mode on OpenAI servers…

Incognito mode just means you don’t use saved cookies.
You are not really incognito when you login somewhere obviously.

4

Fully aware of that. I use incognito for cookie isolation on other sites, just happened to be in incognito when i logged in, noticed it was using o3 mini despite being on o1 pro. I switched back to normal Firefox and o1 pro worked again.

This seems like it might be a bug rather than a feature.