I’m wondering how everyone send the prompt to the server, along with the chat history. What I did is to connect each question and answer and separated with \n, The 1st prompt is sent as is, the following questions will be like this: Q\nA\nQ\nA\n … Q

[image] dwang: I’m wondering how everyone send the prompt to the server My first draft looks something like this (still working on the final code and the chat_messages DB table stuff: Basic Call to Chat Method: messages = [] line = {"role": role, "content": prompt} messa…

[image] dwang: m wondering if there will be an error. I only pass a string which contains all of the chat history. You must pass an array to the messages param just like the API docs show. [image] HTH :slight_smile:

Hi Ruby, if we need to pass previous prompt into next API call ( to preserve the context of conversation ), does it meant we will quickly hit the token limit? no? 2nd Question, is this the method we break through the single call token limit : [image] Much appreciate your input.

[image] zhihong0321: does it meant we will quickly hit the token limit? no? Hi @zhihong0321 You will need to write code as a developer to manage your “conversation” messages and to trim or summarize your content as you reach the max_tokens limit. Yes, this is a current limitation (4096) whi…

OpenAI API (chat method): What is the best way to send questions

API

dwang March 2, 2023, 3:27am 3

Can you pass an array to the API? I’m wondering if there will be an error. I only pass a string which contains all of the chat history.

Topic		Replies	Views
Do I need to send prompt every time for a same task? API	10	16118	February 15, 2024
A conversation using the API API	6	3160	December 16, 2023
Edge Pass 4096 Token Limit. Systematic approach to sent API call API	5	1380	March 6, 2023
Chatbox fine tunning performance Prompting	4	793	December 15, 2023
AI with chat mode in Playground seems more clever than API API	5	2172	April 20, 2023

OpenAI API (chat method): What is the best way to send questions

Related topics