Since upgrading to API version 2, and using GPT-4o, I never get any quoted text in the file_citation data anymore. The quotes from the uploaded text that are part of the response text are much better with GPT-4o, but for my use case I need the actual query results from the vector database.
PS. Just found this response on the topic. Seems like I’ll have to give up on the Assistant API.
Strange that OpenAI would release this API so half baked. What use is RAG if you can not validate the output? 