GPT 4o mini took a hit ever since o1 was released

[_j]

(related evidentiary topic)

Changes to 4o-mini in last 24hrs that would cause performance degradation?

Hi, I’m using an assistant with 4o-mini to evaluate images and I test edge cases to make sure it’s calibrated properly (e.g., ask it to evaluate a picture of an airplane but pass it an image of an apple). Last ~1 mo been using the same prompt and getting consistent results recognizing an image is not relevant (e.g., continuing the above example - recognizing it isn’t an image of an airplane but an apple). In the last 24 hours the model returns completely hallucinated results as if it doesn’t e…