Not enough tokens error, even though I've paid A LOT (maximum context length error)

[_j]

Resources to understand what you are doing wrong:

Not allowed to have all 8192 tokens

You understood wrong. max_tokens is the limit of the response you will get back. max_tokens also reserves space exclusively for this response formation. The context length of a model is first loaded with the input, and then the tokens that the AI generates are added after that, in the remaining space. Language is formed in a transformer language model by continuing the next token that should logically appear one at a time based on previous input and generated response so far. (In an ideal…

Do 'MAX tokens' include the follow up prompts and completion in a single chat session

There are two things that might be conflated here: A model’s context length is the total amount of tokens it can handle at once, a combined count of both the total input that you send and the response you get back. An API call’s max_tokens parameter reserves a specific amount of the context length for forming an answer, and sets the size of the maximum response that you will receive back from the AI. “Followup responses” to me means that you have a chatbot application (instead of just making…