Adding human in the loop(HITL) for language models

ChatGPT
1

I am building a question and answer application using gpt model and retrieval augmented generation approach. I also wanted to add HITL in the solution, but due to the nature of the model there is now way to get a confidence threshold of the answer it gives. So, for these type of models, how do we setup a human in the loop(HITL) in the solution

Thanks

2

Did you ever figure this out? I’m interested in implementing something similar