Advice & Tips for finetuning

Hi @zafarr -

Can you take a step back and explain what specifically you are looking to achieve with your fine-tuning project?

To your specific questions: yes, you would need to provide the context for each example.

How many examples really depends. In some cases 50-100 examples may be enough to get a decent fine-tuned model. In other cases, you may need to create 1,000+ examples for it to work properly. It’s common practice to start small and see where this takes you and then add more examples to further optimize it.

1 Like