My Fine Tuned Q&A Completion Model answers new prompts correctly, but then continues on listing a ton of random items from my JSONL file

Whats going on in my JSONL:

Hello → Hi\n
Goodbye → Bye\n

When I ask my fine tuned model a new question it responds like:

Answer To New Question\n\n
Goodbye → Bye\n\n
Goodbye → Bye\n\n
Goodbye → Bye\n\n
Goodbye → Bye\n\n
Goodbye → Bye\n\n
Goodb

What am I missing here?

Thank you! I’m very confused.
Rick Ryan

Hey Rick! Are you using \n as a stop token?

2 Likes

Yep, you need to use a stop token. \n would be the natural choice here.

1 Like

Yep that solved it! Thank you!! The docs confused me on that one. Didn’t realize stop: [’\n’] existed and it being unnecessary on some other models through me off.

1 Like