Ask about GPT4 temperature?

[_j]

An additional parameter top_p, set to .90 or lower, can remove some of the crazier tokens that could be produced by a high “creative” temperature.

Questions regarding API sampling parameters (temperature, top_p)

Top-p reduces the selectable tokens from the 100% probability space at 1.00 down to only those that include the top 20% (inclusively) at 0.20. It is not affected by temperature. This will make probabilities like: “banana” : 30% “apple”: 20% “orange”: 15% (all others): 35% into a limited set of logits such as: “banana” : 66.66% “apple”: 33.34% Temperature then acts, for example lowering the temperature gives more distance between choices: “banana” : 75% “apple”: 25% (temperature work…