I’m currently working on an AI project, but I’m relatively new to the field and need some guidance. My goal is to utilize AI models, specifically OpenAI models, to generate HTML templates based on some data I have. I explored using Langchain and a vector database. I inserted my data into the vector…

As the error message says, you have too many tokens in the prompt, try to reduce your prompt, or switch to a 16k model: gpt-3.5-turbo-16k

@odb23 Can you post the request and the exact error message? So I can help you figure it out. Normally the max_tokens param you use in API means the upper limit of the response token, and max_tokens(max tokens in response) + tokens in request <= the max context size of the model you use

@kjordan , Thanks for your response. I am using langchain js package and pinecone vector db for this const template = "You are an expert web developer, you use HTML code to create beautiful web pages. The templates provided to you are Tailwind CSS HTML templates. Using these templates as conte…

@lachie1 , Thanks, I will check the thread out.

@kjordan , using gpt-3.5-turbo-16k worked for me. Thanks. @lachie1 , Thanks for your response. I really appreciate it!

How can the OpenAI model's max token length error be resolved?

API

lachie1 June 30, 2023, 1:36am 2

Hey odb23 welcome to the forum. This thread may be helpful for you Ways to automate breaking a large piece of input into chunks that fit in the 4096 token constraint?

Topic		Replies	Views
Token Limitization Error when prompting Prompting chatgpt , api	8	3748	December 6, 2023
How to Handle Token Limit Exceeded Error in OpenAI API API	0	1031	December 30, 2024
Help Needed: Tackling Context Length Limits in OpenAI Models Community gpt-4 , chatgpt , token , rate-limit , openai	8	20842	February 8, 2024
Gpt-4-1106-preview: 400 This model's maximum context length is 4097 tokens API api , token , gpt-4-turbo	8	5898	March 18, 2024
Error: This model's maximum context length is X tokens API gpt-35-turbo	5	16832	September 1, 2023

How can the OpenAI model's max token length error be resolved?

Related topics