Finetuned Model So Bad It Doesn't Work

Here’s what you want to do…

  1. Increase the number of training examples to between 500 and 1,000
  2. Train the model.

My advice for accomplishing Number 1 is to, using as many prompts as necessary, build up a synthetic dataset using GPT-4.

2 Likes