"Which response do you prefer" with plugins?

Has anyone else come across this? Looks like the “which response do you prefer?” test showing up with plugins that are actively being called. I chose one and then it froze a bit and then showed two different outputs. In the backend each was a call to our plugin which is a bit weird.


I’ve not seen it with plugins, but I’ve seen it in regular chat.