Recently I made a post asking about how the order of information in training effects the responses you get.
You can see that linked here: Location of information in training
In that we determined that the order does effect responses generated by gpt-3. We also determined that it is part of how gpt-3 works and there are ways to structure prompts to make this less apparent but you can’t get rid of it. Me and my partner recently started a project that requires fine tuning so we started trying to figure it out. I once again had the same question: Does the order of information in a fine tuning document effect the responses it will give and if so, how much and in what way. We are new to fine tuning and don’t fully understand it. Thanks for your help!