Davinci still seems like the gold standard, compared to turbo

[ruby_coder]

@Securigy

max_token: null, that is, using default value

If you set max_token:null this will overwrite the client max_token value the client sends to the API, but the OpenAI hard limit of 4096 tokens cannot be bypassed or overridden by any client method.

HTH

See also related:

OpenAI API: chat completion pruning methods

Hi All, Hope all is well. I’ve been building out my test lab for the new chat completion API and it works well. The only real challenge has been the method to prune the messages in light of the very restrictive OpenAI API chat 4096 token limitation. This hard limit, as we devs know, generates errors and greatly restricts how developers can use the chat completion method, so I am currently experimenting with various “pruning methods” and if you have any suggests of other methods, please rep…