File retrieval in assistant uses huge amount of input tokens

[_j]

@rn1

What’s the use case for this service?

A forum search for “use case” - to 10 days after release of Assistants, an adequate exploration does indeed already place such a rhetorical question in one’s mind.

Error while using Assistants api

Basically yes. Unlike ChatGPT where the conversation is clipped to where people complain it doesn’t remember anything, assistants will run up the conversation to the maximum of the model when you continue to chat. 128k. Also, when running your own vector database, for example with 1MB of your company’s tech support knowledge base and product offerings, you might have a threshold where only the top 5 chunks are fed to the AI, and only if they meet a semantic similarity threshold. Not the case wi…