Ask about GPT4 temperature?

[angga]

I try using temperature 1.2, and gpt4 response is so Interesting. Unfortunately, sometimes it produces meaningless word or random word that look like a word. Then, i tune the temperature to 1 and 1.1 . The response is so boring. Or maybe like GPT 3.5.

Any recommendation temperature that similar to 1.2? Want to try by myself but the price is so costly.

[_j]

An additional parameter top_p, set to .90 or lower, can remove some of the crazier tokens that could be produced by a high “creative” temperature.

Questions regarding API sampling parameters (temperature, top_p)

Top-p reduces the selectable tokens from the 100% probability space at 1.00 down to only those that include the top 20% (inclusively) at 0.20. It is not affected by temperature. This will make probabilities like: “banana” : 30% “apple”: 20% “orange”: 15% (all others): 35% into a limited set of logits such as: “banana” : 66.66% “apple”: 33.34% Temperature then acts, for example lowering the temperature gives more distance between choices: “banana” : 75% “apple”: 25% (temperature work…