We fine-tuned a davinci model using articles on our website. But, when we try to have a conversation with the model, it keeps repeating information as answer to a questions. Like ”answer phrase 1, phrase 2, phrase 3, then it keeps repeating phrase 3, phrase 4, phrase 3 and so on”.
Did you encounter a behaviour like that? Is it because of the prompt? Because of the training data? Data is good. The answer is pretty ok, but the repetition is kills the effect.