Hello everyone! Ok, I admit had help from OpenAi with this. But what I “helped” put together I think can greatly improve the results and costs of using OpenAi within your apps and plugins, specially for those looking to guide internal prompts for plugins… @ruv I’d like to introduce you to two impo…

This is great; I have to admit that I have largely neglected top_p sampling and have focused primarily on adjusting the temperature. The table of suggested temperature and top_p values for different use cases is very helpful.

Hey @ruv OpenAI has updated the range of temperature to 0-2. Does that affect this table? I’m having issues with the code generation part. this was working perfectly for me before but not anymore?

I saw that and honestly thought this was a bug… 0 - 2? WTF… Why? Because 2 is one better then 1. If they made this change on purpose just stupid… This has to be a bug… Ranking algorithms have been ranged from 0.0 - 1.0 for decades. It’s a percentage. Ranging from 0.0 to 2.0 makes absolutely zero se…

Will lower Top_p provide more deterministic response than higher Top_p or vice versa? Thanks!

Hi, I am interested in using this plugin, but I am unsure of how to begin the installation process. Could you please direct me to any beginner-friendly tutorials? I have been unable to locate any online.

It seems it takes a very low top-p parameter to actually constrain the logits in cases where there is some leeway of choice. At temperature 2, using some very indeterminate leading language, I get sentences that are mostly from the top three when using a top-p 0.05 [image] These low and similar p…

How do I input the temperature and Top_p in ChatGPT API

I just have to switch over to VS Code to grab some example python with lots of parameters pre-filled or ready to accept variables: For Completion, not Chat models ( < python 1.0 API library ) response = openai.Completion.create( prompt=raw_text_messages, # use "completion" techniques model…

Wow, it’s been a while since I’ve checked this thread. Happy to answer any questions.

Cheat Sheet: Mastering Temperature and Top_p in ChatGPT API

API

aiekipa July 27, 2023, 9:17am 19

I just opened the official documentation from openai OpenAI Platform, and they said to either play with the temperature or the top_p command, but not both simultaneously.
See Image below

Topic		Replies	Views
Does temperature go to 1 or 2? API	6	32201	January 12, 2024
TIP: Chat Completions API reference - as a single request, for AI understanding Documentation chat-completion	2	1489	September 1, 2025
Temperature, top_p and top_k for chatbot responses Prompting gpt-4 , chatgpt , api , api-temperature	9	140305	August 18, 2023
Questions regarding API sampling parameters (temperature, top_p) API gpt-35-turbo , api	17	10760	July 16, 2024
A better explanation of "Top P"? Prompting	9	139598	June 14, 2023

Cheat Sheet: Mastering Temperature and Top_p in ChatGPT API

Related topics