Why are my context tokens used so quickly?

If you upload retrieval information, the assistant backend will remorselessly fill the AI model’s context window with information, or if results are not optimum, the AI has its own function to call for more documentaiton in another turn…

I wrote a response earlier about sources of token use, click “Context tokens..”:

https://platform.openai.com/docs/assistants/how-it-works/context-window-management or https://platform.openai.com/docs/assistants/tools/how-it-works

1 Like