Is there a way to get the logprobs of a token (or a sequence of tokens) in the prompt via the API? I see it is possible in the playground (screenshot below), but when working with the API in python, I am only able to get the logprobs of the tokens in the completion.
3 Likes
use echo=True
and logprobs=1
2 Likes