Is it possible to use logprobs with assistants api?

API
1

Is it possible to use logprobs with assistants api? For gpt-4-turbo or 3.5 model. I didnt find the reference in API

2

logprobs are not stored in a thread, which is where your response is formed.

Streaming could have this possibility, but it is not offered.

2 Likes
3

This would be very handy in conjunction with RAG to get confidence in an answer.

I am new here. Does OpenAI usually listen to feedback? Add features to existing APIs? Iā€™d like to use Assistants but this one lack of a feature would me back.

4

@enoch Any update on this yet?

1 Like