Hi folks I’m trying a couple of experiments to get the hang of fine-tuning. I’m building a JSONL with samples of questions and answers, but I’d also like to give the model the right context and instructions, in order to not have to repeat that with every API call. So I started the json with an em…

Adding prompt info to fine-tuning

aakash December 17, 2021, 4:30am 12

I have read this in a number of places. What is the reason for this “behaviour”?

Topic		Replies	Views
Should prompts be unique for fine-tuning? Prompting	9	1710	December 25, 2023
Finetuning for shortening prompts Documentation fine-tuning	10	3774	December 24, 2023
Training gpt-3.5 to autocomplete for a niche domain and a specific writing style Community chatgpt	13	1728	July 25, 2024
Prepare data for fine-tuning a story generator Prompting fine-tuning	4	2014	October 20, 2023
Having trouble to make AI avoid certain topics Prompting	13	3283	April 17, 2022