it cant not use or rephrase As an ‘‘AI language model’’ even it can come up with good rephrases but it fails to apply them to the next question no matter how much you insist he doesnt do it and keep apologizing and that makes it look bad
That is a feature of the RLHF alignment to make you think it’s not a human, or connected to the internet, or whatever you asked it. So either avoid those types of questions, or if you are running this in ops, detect those responses with another AI based classifier, and switch over to DaVinci, or a model without so much RLHF interference going on.
1 Like