Hi,
We are Building chatbot kind of application that should serve our application users to get some insight about out application / functionality by asking questions in the chatbot. for that we deployed chatGPT 4o-Mini models in Azure AI deployment, accessing through Azure API endpoints.
What we do is, passing our custom / dynamic JSON data to OpenAI API along with user question and getting the response/answers from API. What we see is the answers / responses are inaccurate and missing details.
we tried with all possible options such as Correct Prompting, Cleaned and enriched Source Data, Setting suggested Temperature and Top_P parameters etc…,
please share your ideas or experience if you have come across or something pops up in your mind:)