Assistant Document Upload Error Max Tokens Even Though File Is Less Than 2 Million Tokens

I have a 5mb text file that totals about 1.3 Million tokens (confirmed with the cl100k_base encoding in tiktoken), but when I try to add this document to my assistant it gives me the error saying the max tokens per file is 2,000,000, but my file is no where near that large.

Is there a reason for this or just a simple bug?


I have experienced the same thing. As a plus subscriber, the maximum that I have uploaded is around 500k tokens. So i thought, perhaps the 2 mil tokens are only for Enterprise users. Maybe?