Thread token usage endpoint

[jorgeintegrait]

This is a common question that the community still hasn’t found an answer to. At the moment, it is abstracted and you can only estimate it, if you’re interested on that I have a couple recommendations here:

Impact of Instruction Size and Thread Length on Token Usage in OpenAI Assistant

There isn’t clear information on assistant token usage yet. Not on the documentation and not on this forum I’m afraid. Still, it would be natural that the pre-set instructions will consume tokens per message, and that the more tools you use (dalle, retrieval, code interpreter) the longer these instructions are. You can try starting a new assistant with gpt-3.5 with all the tools and no additional instructions and ask it to give you the instructions is has verbatim. This can give you an estimate…