It is possible that it has more tokens, but so far the chat conversions seems like it can handle a lot of tokens than one would expect. My theory is that it probably has a clever way to handle prompt engineering with a combination of summarization and semantic search to minimize the tokens.
3 Likes