I’m trying to finetune a model on call transcripts.
I wanted to ask what would a single data point be?
is it going to be a single message and a single completion?
eg:
prompt: Best country with nature ?
ans: any country (maybe singapore)
but in this case if I type another question, will it get the context?
eg
prompt: I might travel there next year, can you tell me some best places to travel there?
I don’t think so it would be able to respond.
So for a single data point, should I store the whole conversation till now in the prompt?
In the case given above, this works best
eg:
prompt: Best country with nature ?
ans: any country (maybe singapore)
prompt: Best country with nature ?\nans: any country (maybe singapore) I might travel there next year, can you tell me some best places to travel there?
ans: Following are some great places to visit in the (country name)…
Please help