I find this extremely useful. But I’m running out of how much it’ll “remember”. Is there a plan to add memory? Thanks in advance.
1 Like
No, the models are the models, there’s no way to change how much context they can remember.
You can add memory to the LLM by adding history and retrieving relevant past conversations via RAG (embeddings).
The LLM is pretty much fixed, the weights are frozen, mainly due to the massive compute costs of training. So an efficient approach is to inject pertinent context in the prompt to achieve “memory”.
3 Likes