I am using GPT3 to perform some text analysis. I am trying to get from GPT3 a probability about the fact that the sentence refers to a professional context.
For example : “My boss is very nice.” Answer should be Yes with a high probability.
Other example : “I am very exhausted as I worked very hard during the week-end.” Answer should be Yes with a lower probability.
Can GPT-3 give a probability for his answer, I saw that logprobs exist, is it relevant here?
And is it reliable for this kind of task?