Logit_bias not working as expected

  • You won’t see the effect of logit bias in logprobs any more. The post-logit_bias logprobs are unavailable, since this allowed researchers to make many calls and explore the entire dictionary of response values and determine model parameters.

The evidence that it worked is that your response content was ‘B’. The produced content had a lower natural certainty than “The” or “Option” (where the AI wanted to chat), but you still got ‘B’.

4 Likes