does the length of a thread when using assistants increase the context tokens? I noticed today my context tokens has jumped more than usual, im figuring its because I haven’t deleted the thread and started a new one but ive also implemented some new changes so i’m unsure if this is the case
1 Like
Yes. The longer the thread gets the more context tokens you’ll be using with each exchange.
2 Likes
I don’t remember exactly, but i think i saw a parameter to set how many messages you want to for context, it was maximum 20 or 50 messages default, not sure.
Please help me with that parameter name, is very important for me. 
In a run you can set truncation_strategy, max_prompt_tokens, and max_completion_tokens parameters.
All of these will influence the assistant’s performance and token usage.
1 Like