I’m attempting to do something which I thought would be easy but I’m struggling!
I have a large set of question and answers for my bot. I want to use OpenAI to listen to the user and ascertain what they wanted to know - not to answer the question.
For example, I am able to give a prompt like
Decide which of the following questions most closely matches what the user asked.
1 What’s your role
2 What’s your job
3 What responsibilities do you have
4 What do you do
5 How can you help me
6 Can you answer my questions
7 What’s your purpose
8 Why are you here
9 Tell me about yourself
10 Is a financial assistant the same as a financial adviser
And in the playground, using a Q&A model, I get excellent results. However, I only want to go with the answer if the AI is 90% certain that the question matches what was asked. So how can I get the correct question from the set along with a confidence value?
Also, I have almost 1, 000 questions. Does anyone have any ideas on how I can avoid sending them all every time?
Thanks so much for any pointers!