We recently uploaded our knowledge base to an OpenAI vector store and added file attributes to every file for query filtering.
When querying using the search endpoint I noticed some results didn’t have the attributes, which I found odd. Thinking it might have been an upload error I used the list endpoint to retrieve all files from the vector store and every single one of them had the correct attributes attached.
When querying, some suddenly don’t have them and sure enough are not returned as results when querying with filters. This feels like a bug or at the very least some really strange behavior. Do attributes not get propagated to chunks? Does the query endpoint just not correctly look up attributes?
This completely breaks our intended use case and if confirmed means we’ll be moving away from OpenAI vector stores.
Wondering if anyone else has come across this.