When I have an assistant with retrieval enabled and have uploaded files, the API response is not really conversational. For example, when I ask do they serve coffee at the meetings, here is the differences:
completions: “We usually have a coffee station set up during our meetings to help make everyone feel at home. Please make sure to check in with our Hospitality Team when you arrive. They would be more than happy to help you.”
asst. w/ retrieval: “The documents don’t provide specific details about coffee being served during meetings. While it is common to offer coffee, to create a welcoming environment, I would recommend contacting them directly”
what are my options here? use an orchestration agent, add more info files (but feels like overfitting), dynamically switch between retrievers or general chat?
1 Like