What exactly does "probability" mean in this sentence?

[AlexDeM]

Probability, in this OpenAI documentation, is actually the set of two settings, when both are available, that work together: Top_P and/or Temperature.

There is a good thread about it by @ruv:

Cheat Sheet: Mastering Temperature and Top_p in ChatGPT API (a few tips and tricks on controlling the creativity/deterministic output of prompt responses.)

Hello everyone! Ok, I admit had help from OpenAi with this. But what I “helped” put together I think can greatly improve the results and costs of using OpenAi within your apps and plugins, specially for those looking to guide internal prompts for plugins… @ruv I’d like to introduce you to two important parameters that you can use with OpenAI’s GPT API to help control text generation behavior: temperature and top_p sampling. These parameters are especially useful when working with GPT for tas…