Whats going on in my JSONL:
Hello → Hi\n
Goodbye → Bye\n
When I ask my fine tuned model a new question it responds like:
Answer To New Question\n\n
Goodbye → Bye\n\n
Goodbye → Bye\n\n
Goodbye → Bye\n\n
Goodbye → Bye\n\n
Goodbye → Bye\n\n
Goodb
What am I missing here?
Thank you! I’m very confused.
Rick Ryan
luke
2
Hey Rick! Are you using \n as a stop token?
2 Likes
Yep, you need to use a stop token. \n would be the natural choice here.
1 Like
Yep that solved it! Thank you!! The docs confused me on that one. Didn’t realize stop: [’\n’] existed and it being unnecessary on some other models through me off.
1 Like