Fine-Tuning stats show good results but fails in practice

[bill.french]

@DuckLover

The training completed 4/4 epoches.

I’m not an authority on fine-tuning, but I have gleaned from other experts that you may need to increase the epochs before you will begin to see good results from your model.

Fine-Tuning In a Nutshell with a Single Line JSONL File and n_epochs

Those who frequent this community easily notice that developers struggle to get good fine-tunings results. In this multi-part tutorial, I’m going to use the davinci base model and fine-tune it multiple times with the same single-line prompt using different values for n_epochs. I will take a completion with each of these models, and demonstrate that if you set your n_epochs value high enough, you can get excellent results fine-tuning with a single-line prompt! Before we get started, I would …