Hi. I need to make a specific pipeline using ChatGPT. So far it seems like most runs go +/- well, but… Sometimes things become broken. Due to the fact, it only happens with a low chance it seems I can run the same prompts a few times and then compare probabilities estimated by a language model fo…

No probabilities for ChatGPT API responses?

rw1 July 25, 2023, 1:33pm 3

Newer topic about this: #104769

Topic		Replies	Views
Accessing probabilities of all tokens in a response API	3	2340	December 21, 2023
Is it possible to get the entire logits/softmax probability vector of the output? API api	5	3772	December 21, 2023
Is `logprobs` being deprecated, or will it eventually be available for newer models? API	8	10119	December 15, 2023
Confidence score for prompt response API	11	6290	December 21, 2023
Logprobs in ChatCompletion? API api	4	6335	December 17, 2023