Can we use logit_bias with a finetuned model? The next question is how to find the token ID for a finetuned model? Thank you
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Does logit_bias remove tokens from top_logprobs? | 5 | 536 | April 2, 2024 | |
Logit Bias default bias and blocking tokens not in list | 3 | 50 | December 16, 2024 | |
Logit_bias for gpt-4o-audio-preview | 1 | 29 | November 13, 2024 | |
Can I get logits if I go for finetuning with OAI? | 0 | 156 | May 31, 2024 | |
Is it possible to register multiple words for the logit_bias parameter? | 4 | 1130 | October 10, 2023 |