It started this morning. The assistant makes up new info (like address) that’s clearly available in the Vector Store and there are instructions to exclusively reference the Vector Store. Anyone else?
2 Likes
Hi, welcome!
Ya! I’ve experienced something like this. It’s how they’re supposed to work, believe it or not.
It has to do with how the AI uses the Store, which is by “reading chunks.”
It’s a little bit like flipping through a book to find what you’re looking for. It’s good for “understanding” a document, but it’s not good for precision.
If you need something exact—like a person’s address—you are better off with a function call with structured output to a database (or spreadsheet) with the same information.
1 Like
The assistant isn’t properly retrieving data from the Vector Store and is instead hallucinating information. Try these steps:
- Check Data Indexing – Ensure the Vector Store is correctly indexed and up to date.
- Restart or Reinitialize – Restart the assistant or reinitialize the connection to the Vector Store.
- Review Retrieval Settings – Confirm that retrieval instructions are properly configured to prioritize Vector Store data.
- Test with Simple Queries – See if specific searches return expected results.
1 Like