Hi all, I am trying the prompt response, where I used the opeai.completion.creat() to get response, I set the temperature = 0 to get the most probable answer, but I am curious whether I can get the confidence score/probability of the response. Is there any way to get this number? Thank you.

Confidence score for prompt response

jwatte August 29, 2023, 10:46pm 8

Yes, that makes sense; I agree!

1 Like

Topic		Replies	Views
Gpt-4o-mini response evaluation Community gpt-4 , rag , evals	3	171	February 17, 2025
Thought/answer pattern while evaluating confidence from logprobs API chatgpt , classification	0	503	May 24, 2024
How can I get the log probs of the a ChatCompletions object? API	2	1148	December 17, 2023
The Relationship between Best of, Temperature and Top P (The Three Variable Problem) Prompting	10	4637	April 14, 2023
Non-deterministic probabilities for first generated token in chat.completion? API	4	818	April 24, 2024