I input a text of 1 token in response API but it turns out to be 26 tokens in the usage in the response. How is that happened?
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Unexpected token counts of 800 however i have just created a run | 3 | 81 | December 13, 2024 | |
Using the API the token count is off | 10 | 1493 | January 16, 2024 | |
Confusion Regarding Tokenization Calculation in Realtime API and Potential Double Charging Concerns | 2 | 299 | October 15, 2024 | |
Count of input token in playground in Non English language | 3 | 328 | April 22, 2024 | |
OpenAI API: Platform/tokenizer giving very incorrect/inconsistent counts? | 0 | 562 | March 21, 2023 |