Is it OK to repeat rows when fine tuning

I’m working on fine-tuning the model. It’s mind-numbing going through all of the records I have (400K). I have 500 records right now of the prompts and desirable answers.

Is it OK to show the same prompt/completions multiple times within the same fine-tuned model to increase row count? Does the count/size impact results?

You only need 200 examples for effective fine tuning

1 Like