How to avoid completions that include rows of | ------ | ---- | -------- | etc?

[sps]

Hi @mbeddo ,

The can be fixed with logit_bias

Simply find the token value of the sequence you don’t want, using tokenizer, then set its the logit_bias value to -100

e.g {"50256": -100}