Whats going on in my JSONL:
Hello → Hi\n Goodbye → Bye\n
When I ask my fine tuned model a new question it responds like:
Answer To New Question\n\n Goodbye → Bye\n\n Goodbye → Bye\n\n Goodbye → Bye\n\n Goodbye → Bye\n\n Goodbye → Bye\n\n Goodb
What am I missing here?
Thank you! I’m very confused. Rick Ryan
Hey Rick! Are you using \n as a stop token?
Yep, you need to use a stop token. \n would be the natural choice here.
Yep that solved it! Thank you!! The docs confused me on that one. Didn’t realize stop: [’\n’] existed and it being unnecessary on some other models through me off.