Hi all, Some applications of LLMs involve using them to score, not just generate, completions. For example, we may wish to generate several completions under one prompt, and then rank them according to how likely they are under some other prompt. This is possible using the logprobs option in the c…

logprobs has been released for Chat Completions API! Thank you for your patience and support. https://platform.openai.com/docs/api-reference/chat/create#chat-create-logprobs

Bump. I have the same question. Would like to access logprobs for Chat completions.

same! I would really love to use the logprobs parameter

Agreed! logprobs is super important for probabilistic inference. Most distributions libraries provide a pair of methods .sample() to draw new samples and .logprobs() to evaluate existing samples. On top of these two methods one can build lots of probabilistic machinery. We’d love to build that m…

Are there news from anyone who works at OpenAI about this?

The lack of logprobs also obstructs using newer models (GPT3.5/4) with Forward-Looking Active REtrieval augmented generation (FLARE)

There is a recent quote here - they’re working on it [image] Logprobs are missing from the Chat endpoints Deprecations We’re working on closing the last few remaining gaps of the Chat Completions API quickly, such as log probabilities for completion tokens [ source ]

Is `logprobs` being deprecated, or will it eventually be available for newer models?

API

rw1 July 25, 2023, 1:38pm 7

There is a recent quote here - they’re working on it

Topic		Replies	Views
Logprobs are missing from the Chat endpoints Deprecations	13	5293	December 15, 2023
Logprobs in ChatCompletion? API api	4	10100	December 17, 2023
Accessing logprob from API API gpt-4 , api	2	2079	December 15, 2023
Why doesn't the Responses API support logprobs? API api , chat-completion , logprobs , responses-endpoint , responses	7	3830	June 30, 2025
Legacy Property of gpt-4-0314 model API api	3	1494	August 24, 2023

Is `logprobs` being deprecated, or will it eventually be available for newer models?

Related topics