Hi all, I’m about to create my own GPT uploading different documents that it needs to base it answers on. If i were to use an API that links to this GPT, would the words in the documents count as token output/input?
Hi and welcome to the Developer Forum!
Anything the model processes would be counted as tokens used, input for context taken from an API call return values or output created by the model in response to a query.