Fine-Tuning In a Nutshell with a Single Line JSONL File and n_epochs

[ruby_coder]

@mba

However, what I currently do not understand is the benefit of such simple prompt/completion scenarios.

Hi @mba

See this follow-on discussion:

Model Fitting In a Nutshell with a Single Line JSONL File and n_epochs

This tutorial / lab experiment is a continuation of an earlier tutorial, Fine-Tuning In a Nutshell with a Single Line JSONL File and n_epochs, where we focused on insuring a single-line JSONL file would get the “expected” results from the same completion prompt used in the training file. During that tutorial, our machine learning experts correctly commented that by using 16 n_epochs the tutorial (me) had inadvertantly created the ML sin of overfitting. @georgei cornered me in a good way to …