Amadeus:
logit_bias= {15836:-100}
I am not sure what API wrapper you are using, but the logit_bias key is a string because it is a JSON object. It is not possible that the key in a JSON object is an int as you have posted:
logit_bias= {15836:-100}
We (in this community) ran tests all yesterday and and it worked fine with the JSON key as a string, see @curt.kennedy below:
Also, from my testing:
Reference Community Tests:
Just tested this and it is slightly more complex than that because the API describes login_bias as a JSON object, but in fact it an “odd” way of doing things, in my view, but it works.
Without regard to the tokenizer, I simply selected a random token and tested for errors, not if the token was the token expected to effect the completion , which is another topic (which is the “what tokenizer to use” question). I only tested the format of the param object:
Test 1: Single JSON Object
{"2435":…