Diet
3
Hi! Welcome to the forum!
Here’s a solution I accidentally posted into a chatgpt thread; but now that an API user has this problem, it’s perfect!
TL;DR: accept the fact that the model will do it anyways, and use the attention mechanism to inject a stop sequence!
Try it and let us know if it works for you!
2 Likes