Difference between frequency and presence penalties?

[joey]

@TimC

Is this a scaling thing, where presence penalty is a flat reduction if the token has appeared at least once before, while frequency penalty is bigger if the token has appeared multiple times?

Yes, that’s exactly correct!

@TimC

Also, is there an easy way to implement a consecutive token penalty, that scales on the number of identical tokens in a row?

That level of granularity isn’t really possible, but I’d try iteratively increasing the penalty value (e.g. +0.1 at a time) to see how it impacts repetition.