Assistants API File Search Fails despite vector store status="completed"

The documentation states that when a vector store status=completed that it is ready to use. However, sometimes when I create a run immediately after observing status=completed, the model says something like “the document is not available due to a system error”, other times it hallucinates and makes stuff up completely unrelated to what’s in the vector store. However, if I wait a moment, then it starts working normally as if the vector store wasn’t actually completed when it says it was. How can I be sure that the vector store is ready? This seems to be a bug.

Note: I’ve also tried looking at the vector store files status and waiting until both the vector store and all vector store files have status=completed, but the model still isn’t able to access the vector store contents until a few moments later.

Also Note: I’m using the Modify assistant endpoint to add the vectorStoreId to the assistant, and immediately after that I call Create thread and run with instructions like “summarize the attached document in a sentence”. Every time, the model says it can’t access the upload or something like that.

1 Like