Cheat Sheet: Mastering Temperature and Top_p in ChatGPT API

[_j]

@supernovanancy

Colleagues are sharing that you can effect temperature within ChatGPT by entering parameters in your prompt

You win this one by reading carefully!

You can affect the AI with words, but you can’t affect the algorithmic random token choice weighted by likelihood.

Just above:

Cheat Sheet: Mastering Temperature and Top_p in ChatGPT API

Sampling parameters can only be set by programmatic API call to completion endpoints of OpenAI. You can’t talk to the AI about them except to get some sort of incorrect simulation. While this guide in the first post mostly proposes adjusting the two sampling parameters in concert, there are also creative cases for adjusting them in opposite directions. For example, a temperature of 1.5 and top_p of 0.5 can make very diverse options appear at almost every token with ambiguity available, but t…