There is a limit to the number of tokens that OpenAI will work with and track. When I use the API, I have 4000 to work with, but that includes all the state I have to pass in as well as the answer I get. The more data I give it, the less it can give me back. I look forward to 4 megatokens.