OpenAI API Conversation Memory

[ruby_coder]

@humbooz

I was wondering, is this possible at the moment ? What can I do to implement such a feature ?

Hi @humbooz

You need to write some code which implements your messages array pruning, filtering and / or summarization strategy(s).

For example, see this topic:

OpenAI API: chat completion pruning methods

Hi All, Hope all is well. I’ve been building out my test lab for the new chat completion API and it works well. The only real challenge has been the method to prune the messages in light of the very restrictive OpenAI API chat 4096 token limitation. This hard limit, as we devs know, generates errors and greatly restricts how developers can use the chat completion method, so I am currently experimenting with various “pruning methods” and if you have any suggests of other methods, please rep…

HTH