Hi all, I am trying the prompt response, where I used the opeai.completion.creat() to get response, I set the temperature = 0 to get the most probable answer, but I am curious whether I can get the confidence score/probability of the response. Is there any way to get this number? Thank you.

Confidence score for prompt response

hernandezpaul August 28, 2023, 12:12pm 2

Hi @wmarch015 ,
could you please share with me if you have any progress on this topic.
BR.
Paul

Topic		Replies	Views
Gpt-4o-mini response evaluation Community gpt-4 , rag , evals	3	197	February 17, 2025
Thought/answer pattern while evaluating confidence from logprobs API chatgpt , classification	0	530	May 24, 2024
How can I get the log probs of the a ChatCompletions object? API	2	1153	December 17, 2023
The Relationship between Best of, Temperature and Top P (The Three Variable Problem) Prompting	10	4679	April 14, 2023
Non-deterministic probabilities for first generated token in chat.completion? API	4	851	April 24, 2024