how to set max_tokens, temperature parameters when using assistants API? did not find any info in API reference.
Thanks.
2 Likes
max_tokens was certainly handy for keeping prompt+messages to a
rough length. I have had mixed results setting this using just the assistants API. This would mitigate the need for post response checks.
1 Like