A better explanation of "Top P"?

The guidance on not using both didn’t come from me. I’m all for pressing every button.

BTW: The HuggingFace explanation is directionally accurate but technically wrong. Nucleus sampling (Top K) is token based and not words based.

5 Likes