Hi all, I am trying the prompt response, where I used the opeai.completion.creat() to get response, I set the temperature = 0 to get the most probable answer, but I am curious whether I can get the confidence score/probability of the response. Is there any way to get this number? Thank you.

Confidence score for prompt response

jwatte August 29, 2023, 10:46pm 8

Yes, that makes sense; I agree!

1 Like

Topic		Replies	Views
Evaluate confidence on GPT-5 response API logprobs , gpt-5	1	397	October 31, 2025
Gpt-4o-mini response evaluation Community gpt-4 , rag , evals	3	371	February 17, 2025
Thought/answer pattern while evaluating confidence from logprobs API chatgpt , classification	0	691	May 24, 2024
How can I get the log probs of the a ChatCompletions object? API	2	1212	December 17, 2023
The Relationship between Best of, Temperature and Top P (The Three Variable Problem) Prompting	10	4944	April 14, 2023