Can someone pls validate my training jsonl file for fine tuning?

The cake has baked:

Testing completion now.

Yes, it works:

Prompt Setup 1

Completion 1

Prompt Setup 2

Completion 2

So, “there ya go” @sourabhsardesai40. 100% expected results based on your original training data.

It’s just a matter of understanding how to set up your training file correctly (in your case you were missing stops as I pointed out to you in my initial response), making sure you meet the OpenAI API fine-tuning dataset formatting requirements and you run your model (in an iterative manner) and “actually fine tune it” to get the model fit that your use case requires.

You may also find these two “hands on, lab” tutorials (with data scientist comments) helpful:

  1. Fine-Tuning In a Nutshell with a Single Line JSONL File and n_epochs

  2. Model Fitting In a Nutshell with a Single Line JSONL File and n_epochs

Best of luck @sourabhsardesai40 and hope this helped you and you learned something new today.

:slight_smile:

1 Like