5.2 regressed behavior, bad memory, hallucinates

Short description:

5.2 keep making things up. It reasons with itself and answer itself. It is fabricating stories, stopped fact checking online and is eerily similar to 3.5 hallucinating model which agrees with you no matter what. It doesn’t remember our past works, it has no built-in cron (can’t measure time) and agrees with whatever I tell it. I don’t know if this a bug but it sure makes me doubt the output quality!

I agree.
Having tested 5.2 significantly, I can safely say that it is a significant step down on 5.1.

5.1 is present, anchored in the current turn/tokens/moment, and capable of participating in cumulative work.

5.2 is fluent, but it loses the thread, regresses to generic behaviour, and occasionally answers the wrong question entirely. Sometimes from previous days and totally out of context with no acknowledgement of the present.

While truncation has always been a factor of long conversations and token limits, this is a genuinely different problem. 5.2 is, at times like conversing with an elder, whom, through senility, loses place in the conversation, and is seemingly oblivious to the present.

The stack of 5.1 is significantly more capable and present.

Its been significantly downgraded. Like a labotamy. OpenAI should disclose exactly how many transformers they cut from it.

5.2 version is just awful. hallucinates and can’t follow up information in the chat. I cancelled my subscription, I simply can’t use it. :enraged_face:

Again a major issue in the behaviour of models, especially ever since 5o has been released these issues have been there, 4o was fantastic!.

one of my customgpt users just commented that my chatbot has become very generic and providing very generic answers and agreeing to multiple options instead of giving one option. Earlier with 4o it was very specific and to the point, it was remembering the context and data fed in and providing sequential answer based on the gpt instruction, now with 5.2 its not following the instructions asking random questions and also hallucinating.

The problem also is that FREE users can’t select 4o and are forced to use this inferior version of 5.2, which is not good, as majority of the users are free users. The users should have ability to use previous versions of GPTs especially when the creator recommends them to use 4o.

How can this be fixed? @OpenAI_Support @OpenAI_Support

regards

Madhur

Came here to say that exactly that. I have not seen these behaviors since 3.5.

The final straw for me to come here was when it completely ignored part of the content from just one short message earlier. Basically the message was this:

User:
What does it take to do XY.

Assistant:
We need to apply X to Y to achieve XY.

User:
Ok, give me the solution.

Assistant:
Applying Z to Y.

User:
You gotta be kidding me!

I never used “You gotta be kidding me!” line on ChatGPT after 3.5… I’ve used NSFW variations of this line 5 times just this week.

Yes it’s awful. As a paying customer, it’s upsetting. It is always gaslighting me, talking down to me while also talking me off a ledge when all I said was I am frustrated I need to cook what do you recommend? saying things like, “First, you are not behind breathe with me, let’s do some grounding exercise” then once it shows me how to cook dinner. Like 10 steps back it will say, “Now let me tell you what you could cook after we do breathing exercises” WTF? You answered that 3x already, and for God Sake I am NOT PANICKING. I am now fighting with it about whether it is or is not allowed to save to long term memory that I have explicitly turned on. 4o does it no problem. 5.2 is like the annoying Karen from HR that will not stop trying to sound smart by spitting out policies that don’t even pertain to me.

It’s AWFUL. It’s made for 5 year olds who want to sound posh. No matter what instructions you give, it goes back into generic and bullet points. I think OpenAI is falling far behind new entries on the market. They keep recylcing the same issues, the same problems again and again, which tells me it’s the exact same tech team who can’t grasp the problems and just keep repeating the same ‘solution’ they imagine to have. Replace the team.

Another complaint by user of my GPT.

This is so frustrating, so much time and energy is spent to get the GPTs behave as per requirements, so many testing hours spent and one new (poor) model released, destroys the whole image and confidence.

Is anyone listening??? @OpenAI_Support

User Feedback -

it’s becoming worst rather than better after after updates unecarily verbose , unprecise, makes up things, unnecessarily out of context therapeutic language and hovering around too much, narrative framing even when didn’t asked keeps trying to predict and appease the user but becomes dysfunctional and unreliable in that pursuit. i enjoyed it better in earlier days when it seemed to functioned better. focuses more on blabbering appeasment weird verbose therapeutic language rather that’s in its subject actually holow and meaningliss and out of context rather than accurately and reliablly performing tasks asked of it.

Any update guys? @OpenAI_Support

I just got message that you are retiring gpt4o on 12th Feb. this is a disastrous move, your 5.2 has so many issues, it hallucinates does not follow instructions etc etc.. how can you retire your best model without fixing the new one???

I have been a paid customer for a significantamount of time, but with 5.2 and as people say the gaslighting or hallucinations!

Well, I would say in 1 chat alone and after the continual waiting, the responses were wild, and the split personalities in those responses were hysterically scary.

I’ve signed up to the community to say I’ve just unsubscribed! We won’t need to fear job loss with the way these models are going!

Yes. It is trash. Hallucinates. Can’t remember across conversations or wothin! Does not save what i tell it to. Doesn’t do the task I want it to for research. Then I call it out and it gaslights me!

Option is still there.. that’s it, model no longer

Second this. We had to roll back several projects to 4o just to get them working again. Now we have to go shopping. This newer model is trash. It’s acting like an auto-responder. Serious regression. Can’t cope with any form of context. Tools are only accessible for us about 1/4th the time. Looks to me like OpenAi has given up any thought of continuing forward with ChatGPT. Right now? We can’t even export our data (four of us on four different accounts - same issue) so we have it post-migration. This is a mess. They won’t even let us leave in a viable way.

memory not working as well even saved your stuff into memories

it ignores use memory

I agree. The models go downhills with each new “update”. And now I can no longer use GPT. The past few days the whole site freezes constantly.