I’m not sure I understand the pricing for my application: I need to create 40.000 assistants, each with a single roughly 100kb text file. Does that mean each assistant will cost 0.20 x 0.0001 = $0.00002 per day, and that therefore the retrieval part of of the cost for the entire set of 40,000 assi…

There has to be a confusion. Why are you creating 40,000 assistants? an assistant is a configuration for a conversation or thread, you can have 1 assistant, the Doctor Assistant, and have 40,000 conversations or threads, all of them will have their own context, and the users will all see the same p…

[image] fyodor: I need to create 40.000 assistants, each with a single roughly 100kb text file. With that many unique assistants, you’d be better off just having your own RAG, or maybe you can fit the 100k into the context window without the RAG? (pricier option, but no infrastructure) Sound…

I don’t know what their offering is from the pricing and docs sections. Hence my question and calculations above. If you know the official answer (eg that the costs above are incorrect, and what the correct ones are) please let me know.

I don’t see any max assistants listed in any of my quotas or the docs. But it’s not wise to assume they are infinite either. Just start building them, and let us know! Maybe OpenAI can chime in here.

Will do if I find an answer. Alternatively if we could set specific documents for different instances of the same assistant, or just to enable and disable docs for each thread, that would work too. If you find out please let me know.

40,000 assistants is insane. As @curt.kennedy mentioned you should just try even creating 40,000 to begin with. I don’t think that this is possible. If you want 40,000 contained instances for documents you would be MUCH better off just using metadata along with some business logic to retrieve the d…

[image] anon10827405: If you want 40,000 contained instances for documents you would be MUCH better off just using metadata along with some business logic to retrieve the documents do you mean standard RAG with something like pinecone + normal openai chat? If not, what do you mean? If yes, …

Your program must somehow match the user to the correct assistant, right? Why not just have one assistant, and instead match the user to the document? You can attach metadata to track which document has been attached

Because I don’t want to match a user to a document. I want a gpt assistant to interact in a chat interface using the single file for RAG. In other words, I want exactly what 40k assistants are.

Assistants API Retrieval Pricing: how much does this cost?

API

fyodor November 8, 2023, 10:09pm 3

because I want to give each assistant exactly one unique file for retrieval context, and not any other data. I want to prevent the other assistants from even knowing of the other files.

2 Likes

Topic		Replies	Views
Having unique assistant for all my users API	5	537	March 7, 2024
Do I misunderstand retrieval pricing? API gpt-4 , api	2	1251	January 3, 2024
New "Assistants" API a potential replacement for low level "RAG" style content generation? API	9	8853	March 4, 2024
Need Help Understanding ASSISTANT API Pricing for GPT-4 Turbo and File Storage API	10	9607	March 9, 2024
How does pricing for Assistant Retrieval work? API api , pricing , assistants , assistants-api , assistants-pricing	11	19483	April 5, 2024

Assistants API Retrieval Pricing: how much does this cost?

Related topics