Maintain the context within the 4096 max tokens

[ruby_coder]

Hi @mrsalzan

See, for example:

OpenAI API: chat completion pruning methods

Hi All, Hope all is well. I’ve been building out my test lab for the new chat completion API and it works well. The only real challenge has been the method to prune the messages in light of the very restrictive OpenAI API chat 4096 token limitation. This hard limit, as we devs know, generates errors and greatly restricts how developers can use the chat completion method, so I am currently experimenting with various “pruning methods” and if you have any suggests of other methods, please rep…