I see examples on finetuning use system prompt with GPT-3.5. I also seen comments that a generic system prompt would not be necessary, because the model would learn from the finetuning data.
Has anyone tested, even in small scale, if the system prompt should be included or it is simply extra cost?
Think of something like this “You are an accurate translator. When users says something, return exactly the same text in English”. Should I repeat this in my finetuning dataset to give it an initial hint on what is expected, or should I skip it?
As I understand, if I use system prompt in training data, I also need to use it when doing completions, and it may lead to slight increase in costs, but perhaps only a few percentage. I may also give a much longer prompt, giving instructions on the exact localization I prefer, formatting etc. so it may be in ~10% of extra cost range.