I’m trying to fine-tune a model for basic categorization
eg:
Apple->Fruit
Cucumber->Vegetable
Pork->Meat
Should i train the model with these lines?, eg:
{"prompt": "Apple ->", "completion": " Fruit\n"}
…
Where would i put the context/instructions for a prompt when fine-tuning?
eg, in the playground i would write:
The following is a list of foods and their categories:
Apple->Fruit
Cucumber->Vegetable
Pork->Meat
Banana->
Also, once the model is fine-tuned… do i always need to put the instructions (The following is a list of foods and their categories) into the prompt? It costs tons of credits to do so… Or do i just put
Banana ->
there ?