My question is that when using the Assistants API with a knowledge base, the number of tokens required for the context is in the tens of thousands, and this is only for the first question in a session. The number of tokens will multiply for subsequent questions, making the cost too high. I hope this can be improved.
1 Like