Hi. I need to make a specific pipeline using ChatGPT. So far it seems like most runs go +/- well, but… Sometimes things become broken. Due to the fact, it only happens with a low chance it seems I can run the same prompts a few times and then compare probabilities estimated by a language model fo…

The lack of logprobs also obstructs using newer models (GPT3.5/4) with Forward-Looking Active REtrieval augmented generation (FLARE)

No probabilities for ChatGPT API responses?

rw1 July 25, 2023, 1:33pm 3

Newer topic about this: #104769

Topic		Replies	Views
Why doesn't the Responses API support logprobs? API api , chat-completion , logprobs , responses-endpoint , responses	7	3471	June 30, 2025
Accessing probabilities of all tokens in a response API	2	3180	August 28, 2023
Logprobs keep changing when using the same prompt in chat.completion API api	3	1699	March 5, 2024
Is it possible to get the entire logits/softmax probability vector of the output? API api	4	11883	September 15, 2023
Is `logprobs` being deprecated, or will it eventually be available for newer models? API	7	15426	December 15, 2023