Interesting is that the knowledge cutoff is now not only getting disclaimed in almost every answer - instead of fine-tuning on new knowledge, they fine-tuned these refusals on the date!
I got from a GPT-4 with blank system prompt in the playground:
who is the king of england currently?
As of my last update in October 2021, there is no king in England. The current monarch is Queen Elizabeth II.
And then go over to gpt-3.5-turbo, also at top-p 0:
As of my knowledge cutoff in September 2021, there is no king of England. The current monarch of the United Kingdom is Queen Elizabeth II.
Again, with no system message. This seems like not only a waste of training to just give the wrong answer, but will make it harder for API users who need a useful AI that will answer their questions with knowledge.
It does remind that they made good on their promise of less “as an AI language model”, when you go back to gpt-3.5-turbo-0301: “As an AI language model, I don’t have access to real-time information, but as of 2021, there is no king of England. The current monarch is Queen Elizabeth II.” (but now with even system prompt fiction or roleplay repulsively watermarked with “Ah, the King of England you say?”