OpenAI releases updates to fine-tuning and custom models

[_j]

Already had been doling info about it.

Validation loss vs. full validation loss

New fine-tuning has some new things I haven’t fully explored that simplify advice I’ve handed out before to continue fine training in small steps. Specifically: you have the n_epochs hyperparameter that specifies how many passes will be done through your training data. There is now checkpoints - individual models produced at the end of each epoch pass, so you can find where they become overfitted (which at the learning rate of your graph, happened quite early. https://platform.openai.com/docs/…