Hi, what am I missing? Doc says 512mb limit, but not the tokens. What is wrong? Basically I was just trying to create an assistant with Retrieval tool, I did file specifically less than 512mb tried it and got this error.

For context, part of the reason for the 2 million token limit is that the retrieval performance really begins to degrade after that point, so paying for storage on tokens more than that is not really worth it (though we are working on it). The best way to do this today is to split the files up into…

Hi and welcome to the Developer Forum! Not seen that message before, 2M tokens would equate to approximately 8Megabytes of pure text.

I’ve seen that message in messages before. [image] Error uploading file to retrieval API I’m testing retrieval in the Playground for the new Assistant API. I uploaded a 51MB file (JSON). When pressing save, I’m getting the following: Failed to update assistant: UserErro…

Hi guys, thanks for fast response. @_j hmm thanks, but what does it mean though? I need to upload huge files for retrieval, like all 20 will be 500mb for sure. Does it hard limit of backend engine, or what?

It means that the documentation does not match the capabilities seen in practice. If intentional, I expect that someone scratched their head hard about the backend costs of chunking and embedding half a gigabyte of data just so someone can ask some questions only informed by 0.001% of that upload. …

Yeah, same feelings. Don’t get this monetization strategy, also seems like they are quite weak in writing API layer…

Same error with a 45MB file, got around it by breaking up into 12MB

Getting the same error with 11.4MB json files. Lame.

You people are trying to upload a full Oxford Dictionary or what :sweat_smile:

It would be very helpful, if developers would add the size of file in tokens (not bytes) to " Files" in the Playground, for example.

As for me, I tried to use this tool to get abstracts for pdf files with pictures. Somehow, even if they are small in number of characters, they still don’t pass through.

Failed to index file File contains too may tokens. Max allowed tokens per file is 2000000

API

_j November 19, 2023, 12:55am 3

I’ve seen that message in messages before.

Topic		Replies	Views
Issue attaching 1000 token txt file to assistant Bugs api	1	289	June 24, 2024
"Unable to extract text from ..." error when uploading files for creating custom GPT Documentation gpt-4 , chatgpt	25	32750	August 12, 2024
20 files per assistant clarification API api	15	9304	November 15, 2023
Error uploading file to retrieval API gpt-4-turbo	4	944	November 14, 2023
Assistant Document Upload Error Max Tokens Even Though File Is Less Than 2 Million Tokens Bugs assistants , assistants-api	1	508	January 19, 2024

Failed to index file File contains too may tokens. Max allowed tokens per file is 2000000

Related topics