Hi, what am I missing? Doc says 512mb limit, but not the tokens. What is wrong? Basically I was just trying to create an assistant with Retrieval tool, I did file specifically less than 512mb tried it and got this error.

For context, part of the reason for the 2 million token limit is that the retrieval performance really begins to degrade after that point, so paying for storage on tokens more than that is not really worth it (though we are working on it). The best way to do this today is to split the files up into…

Failed to index file File contains too may tokens. Max allowed tokens per file is 2000000

API

_j November 19, 2023, 12:55am 3

I’ve seen that message in messages before.

Topic		Replies	Views
Issue attaching 1000 token txt file to assistant Bugs api	1	207	June 24, 2024
"Unable to extract text from ..." error when uploading files for creating custom GPT Documentation gpt-4 , chatgpt	25	31239	August 12, 2024
20 files per assistant clarification API api	15	8867	November 15, 2023
Error uploading file to retrieval API gpt-4-turbo	4	860	November 14, 2023
Assistant Document Upload Error Max Tokens Even Though File Is Less Than 2 Million Tokens Bugs assistants , assistants-api	1	470	January 19, 2024

Failed to index file File contains too may tokens. Max allowed tokens per file is 2000000

Related topics