Is there a way to get the logprobs of a token (or a sequence of tokens) in the prompt via the API? I see it is possible in the playground (screenshot below), but when working with the API in python, I am only able to get the logprobs of the tokens in the completion.
korabs
3
use echo=True
and logprobs=1
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Get logprobs for prompt tokens, not just for completion? | 2 | 2356 | April 14, 2024 | |
| Logprobs for prompts | 0 | 1139 | February 7, 2023 | |
| See probability of existing tokens | 2 | 6081 | April 20, 2023 | |
| Accessing probabilities of all tokens in a response | 2 | 3180 | August 28, 2023 | |
| Logprob value is unbounded, i used sigmoid (converting API logarithm to probabilities) | 5 | 1801 | November 12, 2023 |