I found this reply fixed it for me. Memory Not Updating in ChatGPT 4o – Issue Persists Across Conversations - #28 by allenstein
Long story short, some kind of corrupted memory with formatting like markdown causing the bug. Clearing it out fixed it for me.