Hello,
The top_p AI parameter default value is 1, but what is its value range?
Is it 0 to 1 or 0 to 2?
Thank you.
Martin
Top-p is a probability mass. Probability is 0.0-1.0
1.00 = 100% of all token logits can be selected from.
There’s nothing higher than “all”.
0 is technically not allowed, as that would exclude all tokens, so it just represents a small value in practice.
3 Likes