Sometimes GPT-4 thinks it’s 3.5?

When using GPT-4 turbo, sometimes an old knowledge cut off date of 2021 is returned, and it says it’s GPT3.5.

It’s only occasionally for one conversation, then the next conversation will go back to knowing about 2023.

Any ideas why this might be happening?

On your iPhone 12 Pro Max/13 Pro Max you are using someone else’s app? Are you using their chat services or does it want your API key?

The AI model isn’t trained on answering about itself. GPT-4 Turbo didn’t exist at the knowledge cutoff (which is April 2023).

A system message is required telling the AI what it is and that model’s capabilities if you want to simply get that answer back when you ask.

Hi, thanks for the reply.

I’m providing my own API key to the iOS Pal app, and it’s set to use GPT-4 Turbo.

The issue is more the reported knowledge cutoff is not correct.

Sometimes it says 2021, most of the time it reports April 2023.

Is this not supposed to be reliably correct?

For the AI to answer about itself, it has to be informed about itself, which the app maker didn’t do.

The AI model is not pretrained on thorough or reliable answers about its capabilities.

Also, consider any app you don’t write yourself to be suspect and dangerous. You are handing over the password to your bank account with an API key.

1 Like