Yeah, you could untrain the model I guess. I was thinking either you manually vet nominated changes before training, or establish customer personas as a means to separate bot behaviors. I think this kinda leans into this approach.
Check this in the playground, paste any text of yours and hit the “submit” button. It will rewrite your text in “neutral style”.
Then the fine tune .jsonl file for you would be formatted like this:
{“prompt”:“<|startoftext|>HERE_GOES_THE_NO_STYLE_TEXT<|endoftext|><|startbrandedtext|>”,“completion”:" HERE_GOES_YOUR_ORIGINAL_TEXT<|endoftext|>"}
So it will be:
{“prompt”:“<|startoftext|>I understand. Thank you for the assistance, @RonaldGRuckus .<|endoftext|><|startbrandedtext|>”,“completion”:"…
Here follow the no style sample from the playground:
Hello Jone Doe, I hope you are doing well. You provided assistance with some electrical jobs a few years ago and I am reaching out again regarding a setup for one of those portable generators. Do you offer this type of service?
Hello Victoria. We have decided to cancel our services. Unfortunately, the cleaning that was done last time did not meet our expectations. Even without the use of a good vacuum, there were still areas that were missed…