Hello I have a dataset consisting of dialogues between two people which I would like to use for fine-tuning GPT. Please see below for two example dialogues. The dialogues vary in length and can be longer than the examples. Is the format of the conversations ok? For fine-tuning, should I just conca…

For a generic back and forth, try creating a jsonl file like this: {“prompt”: “Hey there. What’s up?\n\n###\n\n”, “completion”: " Not much, just hanging out. What about you?“} {“prompt”: “Not much, just hanging out. What about you?\n\n###\n\n”, “completion”: " Just thinking about what I’m going to…

Thank you very much. Could it be a problem that with your version we only have one previous message taken into account but usually for a conversation many more previous message are important for the context?

You are correct, there is only the previous input taken into context to produce the next output. But your example seemed to have a gentle back-and-forth feel to it, without a deeper prior context. To have a deeper context ‘virtual you’, I think you need at least two fine tuned models. And the mor…

Did you figure anything out about this @Helveticus ? @curt.kennedy ? I’m also looking for fine-tuning gpt3 on the conversational data where the data is highly contextual.

Fine-tuning on conversations

API

curt.kennedy April 4, 2023, 2:34pm 6

@micamecava I found a possible personally extracting solution over here Extracting Personalities from past Conversations? - #6 by curt.kennedy

Topic		Replies	Views
Extracting Personalities from past Conversations? API	16	4308	October 11, 2023
OpenAI Fine-Tuning: Multi-turn Dataset Examples API openapi , fine-tuning , gpt-3	5	10739	November 2, 2023
Train back and forth dialogues Prompting	13	2138	March 15, 2022
Fine-tuning GPT-3 on entire conversations to mimic style and extract relevant knowledge API	12	5223	March 11, 2022
Fine Tune to emulate my chat style API fine-tuning	7	3042	December 8, 2023

Fine-tuning on conversations

Related topics