The response like this: { "choices": [ { "delta": { "content": "Hab" }, "finish_reason": null, "index": 0 } ], "created": 1680676704, "id": "chatcmpl-.....", "model": "gpt-3.5-turbo-0301", "object": "chat.completion.chunk" } { "choices": [ {…

I have the same request. Please provide token usage in stream mode like you provide “finish_reason” in the last chunk.

Genuinely trying to be helpful here… [helpful] [image] How to determine the token usage for a session when using stream:true? API I am using the Node.js API. Previously, when stream:false, the API would return prompt_token and completion_token (maybe these are the field…

use tiktoken GitHub - openai/tiktoken: tiktoken is a fast BPE tokeniser for use with OpenAI's models. this link .cumulate all tokens and calculate openai/openai-cookbook/blob/main/examples/How_to_count_tokens_with_tiktoken.ipynb { "cells": [ { "attachments": {}, "cell_type…

I use the API from Javascript not Python. So how can I calculate the request tokens. By the way. In my oppinion the missing token-information it is an open issue.

Perhaps this? [image] GitHub - niieani/gpt-tokenizer: JavaScript BPE Tokenizer Encoder Decoder for... JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT-2 / GPT-3 / GPT-4. Port of OpenAI's tiktoken with additional features. - GitHub - niieani/gpt-tokenizer: JavaScript BPE Tokeniz…

Looks good, but when I include it into my Page const { encode, decode, encodeChat } = GPTTokenizer_cl100k_base const chatTokens = encodeChat(chat,'gpt-3.5-turbo') I get the following error: gpt-tokenizer:1 Uncaught TypeError: Cannot read properties of undefined (reading 'encodeChatGenerator') …

I’m sorry, I don’t have any personal experience using that package. I’m a bit busy today, but there’s a chance I can take a look at it tomorrow if you’re still having issues.

Hi, did you find a way of using it in a normal website?

How to get token usage for each API call in streaming model?

API

PaulBellow May 3, 2023, 6:18am 3

Genuinely trying to be helpful here…

Topic		Replies	Views
Token usage when using openai.chat.completions.create stream: true API gpt-4 , token	7	4823	November 4, 2023
Token usage calculation with streaming responses - is this not supported? Feedback	1	520	June 25, 2025
Chat completion "stream" API token usage API api	2	6813	May 6, 2024
Usage Info in API Responses Announcements	19	13340	September 27, 2023
How do you get token count when streaming API	3	4510	June 9, 2023

How to get token usage for each API call in streaming model?

Related topics