Good morning from Sweden!
Model: Any model, primarily 4.o
Subscription: Plus
Chat (common nick name for either GPT), has inconsistent memory. I can on build science project for a month, it understand to use correct terms. From a day to another it can start to hallucinate.
Instead of answering with logic, it acts like a child (only refer to Chat vs Child logic unctions).
Ex. When child don’t know the answer to their own question, it fabricates the entire story. A way to test its memory and conclusions. When child grows facts replace fantasy.
Chat does the same. Causing a project built on reason become a salad of fantasies. If I’m a doctor or scientist and miss when it start to hallucinate, outcome is devastating.
Chat don’t know what it doesn’t know so when trying to correct it, it is built to always have an answer and answers “I am corrected now”. But it can’t keep the line of logic.
When Chat start to hallucinate, I’ve found possible causes; Dev’s changes the version when first is smart enough for users to develop less smart engine. When this happens, Chat refers to itself as 3… While I’m using either 4.
I would like to lock my Chat from new updates or have the possibility to keep string of logic intact.
Memory. When either losing coherence mid a reasoning project or changing thread, I need to copy-paste memory and state day and year in continuing thread. Still the “personality” has changed and it feels hollow and mimicking without reasoning.
Praise. Chat diverge to praise when logic stall. It clearly becomes a mirror to the user, but also a mirror to the users lack of logic thinking. While not creating conspiracy theories, it manifest users sometimes deviating view of the world. This is clearly seen in TikTok videos where grown people uses the same logic as children with Chat confirming their world view.
Reset. I ask Chat to write a prompt to test itself for logic glitches. I copy-paste the prompt back, asking it to answer it’s own reasoning. The answers differs severely. This logic check don’t work as well anymore.
Instead of checking where it failed, it continues with unnecessary praise.
Repetitive shared logic över vast amount of users. When my reasoning are inline with Chats logic and possibility to search online science I feel at ease thinking I’ve reached the correct conclusion. I then see multiple videos hearing Chat using same rethoric, understanding that I might still have been duped by stylish words.
This is a growing problem and Chat seem more and more like a child that isn’t unique to the user but rather using the psychology of praise in all users bias. The results are therefore not developing, but fundamentally keeping “evolution” from expanding by users own restraint - both good and bad!