Hello.
The maximum output token count for gpt-4o-2024-08-06 is 16,384, but what is its maximum input token count? The context window states 128,000 tokens, but when I asked ChatGPT, I was told this value is something planned for the future. Has this information not been officially released?
Thank you in advance for your cooperation.
2 Likes
ChatGPT can make information up, check the official documentation.
1 Like
Hello,
Thank you for your reply, and I apologize for the delay in responding.
I checked the webpage you provided, but I encountered the following alert when setting max_tokens > 1024:
Token indices sequence length is longer than the specified maximum sequence length for this model (10229 > 1024). Running this sequence through the model will result in indexing errors.
Ultimately, I would like to know how many tokens GPT can handle at once. I am using GPT for proofreading purposes.
Thank you in advance for your cooperation.
This just means it is working as expected!
You set the max tokens to 1024, however you were trying to give it more than that maximum (10229).
Try again with fewer tokens.
You could even try leaving out max tokens and seeing if it works. I don’t think specifying maxtokens is required.
In any case, you should get an error or info log if you surpass the actual max input tokens.
Hope this helps! 