GPT-4 doesn't commit anything to memory until special instructions

[NeverEnding_Story]

I turned on memory 2 days ago, and was very unpleasantly surprised to realize that it added to memory only one thing that I explicitly told it to commit to memory, and zero context from half a dozen conversations =(