I’ve been experimenting a lot with logit bias, and it seems that if you insert a a very significant bias, outputs are significantly shortened, even to empty outputs in consequent requests (relative to responses for the same prompts without bias).
Is it something anyone else encountered? Any theory as to why this happens?
Thanks,
Alex