Hi all, I am trying the prompt response, where I used the opeai.completion.creat() to get response, I set the temperature = 0 to get the most probable answer, but I am curious whether I can get the confidence score/probability of the response. Is there any way to get this number? Thank you.

Confidence score for prompt response

hernandezpaul August 28, 2023, 6:25pm 4

Hi @jwatte,
Great answer, thanks.

Do you know how is this related to the logprobs parameter available in the deprecated completions Api?

Topic		Replies	Views
Gpt-4o-mini response evaluation Community gpt-4 , rag , evals	3	209	February 17, 2025
Thought/answer pattern while evaluating confidence from logprobs API chatgpt , classification	0	533	May 24, 2024
How can I get the log probs of the a ChatCompletions object? API	2	1155	December 17, 2023
The Relationship between Best of, Temperature and Top P (The Three Variable Problem) Prompting	10	4685	April 14, 2023
Non-deterministic probabilities for first generated token in chat.completion? API	4	855	April 24, 2024