How to get token usage for each API call in streaming model?

[PaulBellow]

Genuinely trying to be helpful here…

How to determine the token usage for a session when using stream:true?

I am using the Node.js API. Previously, when stream:false, the API would return prompt_token and completion_token (maybe these are the field names). But after using streams, I cannot find these two fields. How can I accurately retrieve them? --Translated from ChatGPT

OpenAi API - get usage tokens in response when set stream=True

However, after extensive testing, I found that the token value calculated by the calculator for offline token calculation is far from the actual value used. So Python’s tiktoken is not reliable. However, please find attached the method I am currently using to calculate tokens: Each stream containing an answer is treated as a token, and when all these streams are added up, they are equal to all the tokens in this question. This is the method for calculating the response token. The token method…