Does uploaded document count as Tokens?

As the title stated. Instruction Strings are token. How about the document? What if I have a huge database in the uploaded document?

If upload document doesn’t count as Tokens, can I put part of the instruction in the document? like putting the formula in the file, and in the instructions I will just say run the “ABC formula” in the file?

No they do not count as token for sure. Because the text chunking, embedding and vector store is being handled by openai - at best embedding API cost maybe incurred. But tokens are not consumed by uploaded files. This is to the best of my knowledge.

1 Like