Fine Tuning - Should we have a file for each style prompt?

Yes, you would want a fine-tuned model for each one. So this would just be 4 out of your 10 monthly runs, so you would not run into any limits. Keep in mind, though, that you need a few hundred examples for each. I am working on my own first runs but I am aiming for 1000 samples per fine-tuned model, so it’s taking some time. In my case, I am using DAVINCI-INSTRUCT-BETA as well as some raw source data to generate my samples, and then cleaning up by hand. I wrote about it here: What are your favorite text-based dialog datasets?

5 Likes