A few days ago, I wanted to try playing a game with ChatGPT and started a session using a specialized GPT. At first, everything seemed fine. However, I noticed that it began to forget some details, like the abilities of my character. Regardless, I continued playing. Later I asked how much gold I had accumulated, but the AI only remembered the gold reward from the last quest, even though I had looted gold multiple times and received numerous gold rewards. When I mentioned the names of the events from which I had earned gold, the AI acknowledged my statements and attempted to add gold from those events, but the amounts were incorrect. Only after I directly quoted it, saying, “Here, I am quoting from you: ‘He presses a heavy pouch of gold (xxgp total) into your hands.’ What is xx?” it managed to fill in the gaps accurately. This experience made me realize the futility of relying on AI in a long conversation.
Just to clarify, I’m not asking for something overblown, like remembering everything I’ve said until now in all conversations or retaining memories across conversations. I just want it to track and remember everything said in the current conversation.
Edit: Now I realized another thing: setting aside the issue of remembering or tracking a conversation, it can’t even search through a conversion. With all of humanity’s knowledge and the entire internet at its disposal, it can effectively search for and gather information from them and does pretty decent work on that. However, it struggles to search through its own few dozen messages, the peak of irony. To clarify, when I ask, “How much gold have I accumulated so far?” even if it couldn’t remember or track that information, it could search through our entire conversation, calculate the total from all my gold earnings and expenses, and provide the answer. Unfortunately, it can’t even do that.