ChatGPT has a historical awareness within a conversation that seems, to me, beyond the 4,000 token limit.
What exactly does ChatGPT have that a playground conversation “with an ai assistant” doesn’t have?
1 Like
ChatGPT is a small fraction of the size of GPT3.*, so I believe the token limit is significantly higher, but I don’t think we’ll know exactly until the ChatGPT API drops. I’m not sure if they use the summarization trick, but you can implement it yourself by summarizing the conversation history before prepending it to the current prompt
1 Like