Hi, I have a task that involves sending to API the same large amount of prompts but only with a few new sentences at last. I wonder if OpenAI saves previous chat in some way maybe as embedding, so I can send that same pre-prompts to it once, and resume every time with new questions. In that way, I …

That’s not how the models work. What you are asking is simple not possible. The models are stateless so every time you want to exchange messages you must send everything you want the model to have in context.

Is it possible to reuse previous chat history on the OpenAI side to avoid sending repetitive tokens?

API

fjd May 13, 2023, 3:09am 3

Yeah I am looking for basically the same thing but with API, because I do have many requests at the same time

1 Like

Topic		Replies	Views
System Prompt ( Sending each time instead of once ) API api	14	9833	May 15, 2024
Efficient stateful completion chatbot API	10	5059	July 9, 2024
Is possible OpenAI API caching the conversation? API	4	3684	June 4, 2024
How do I avoid wasting tokens by passing old messages API question	3	3888	May 11, 2023
Continuous chat conversation that keeps all the past context by API API	3	6028	September 4, 2024

Is it possible to reuse previous chat history on the OpenAI side to avoid sending repetitive tokens?

Related topics