Hi there, is there a way to get the token count of a completion as part of the API call or in a separate call? Like a programmatic version of our usage page so we can tie usage amount to users?

It would be great if there was a pre-tokenizer endpoint or something like that.

[Screenshot from 2021-06-24 15-25-25] I did what you ask adding echo:true in api call via curl and in response I get back this where I should look for token count logprobs is null here

OK now I get you in this case I also need to provide logprobs=1 don’t know why?? curl https://api.openai.com/v1/engines/davinci/completions -H “Content-Type: application/json” -H “Authorization: Bearer YOUR_TOKEN” -d ‘{ “prompt”: “The following is a conversation with an AI assistant. The ass…

hey that’s just an one case but there are many but I find in docs [image] gpt-3-encoder Javascript BPE Encoder Decoder for GPT-2 / GPT-3 may this is can be more simpler to use I

Token count for completion call?

API

sergeliatko June 25, 2021, 8:57am 9

@jloganolson I asked that in feature requests a while ago, no update yet, but hoping Feature request: Total tokens used in request - #3 by sergeliatko

Topic		Replies	Views
Feature request: Query token counts via API Prompting	3	1716	May 24, 2022
Token usage when using openai.chat.completions.create stream: true API gpt-4 , token	7	4816	November 4, 2023
OpenAi API - get usage tokens in response of the api requests? API	1	10253	January 1, 2023
GET completion/{id} endpoint for usage backfill Feedback	1	595	September 28, 2023
Feature request: get generated tokens back with request API chatgpt , api , feature-request	4	1049	July 29, 2023

Token count for completion call?

Related topics