For example, based on OpenAI API. the word “experimenting” contains 3 tokens. If I hit the max_token limit at “exper”, will it stop at the word before it in the completions response or will it output “exper” and then stop?
It’ll stop mid-word … based on settings.
Hope this helps.
1 Like
It will do the above, not based on word boundaries but tokens.
HTH
1 Like