Answering questions about text file content

[kaww]

Chatgpt is different.

When conversation grows larger, did ChatGPT include all of the conversation context for every chat

No, all of the messages are likely not included. There is a finite amount of context that can be passed for each request. We have a truncation algorithm running behind the scenes that tried to determine what the important information is from previous messages that needs to be included.

If you use api, send all at once when gpt support 32K or more…

I wish that when using the GPT API, it would be possible to have a contextual conversation like chatGPT

As the title suggests, I wish natural contextual conversations were possible when using the API. I know how to ask a question by including the previous conversation in the prompt, but this method is limited as it consumes a lot of tokens. I am wondering if there is any other way other than this. And chatGPT allows you to utilize previous conversations regardless of length or quantity, but I wonder why it is not possible in API. If anyone knows please help. plz