GPT-3 responds in place of GPT-4

API
1

Hi, as I also reported at GitHub (openai-php/client project), it would seem that requests made to the GPT-4 model are answered by GPT-3.

In details:

If I ask GPT-3.5 from openai chat panel “User
Identify yourself: AI name and version” replies: "I am ChatGPT, an AI language model developed by OpenAI. I am based on the GPT-3.5 architecture. How may I assist you today?”.

If I ask GPT-4 the same thing he replies: “I am ChatGPT, an artificial intelligence developed by OpenAI. Specifically, I am based on the GPT-4 architecture. My purpose is to provide assistance, information, and perform tasks involving natural language understanding and generation. It’s important to note that as of my training cut-off in September 2021, I am unable to access real-time data or learn new information after that date”.

The problem is that when I ask the GPT-4 model with PHP client (openai-php/client) it replies identifying itself as GPT-3. This doesn’t surprise me: because it makes the same mistakes as GPT-3.

2

The ChatGPT AIs are provided a bit of information you don’t see in a system role. Their system role message tells them information similar to “You are ChatGPT, based on GPT-4 from OpenAI…”

(that information about the model is actually not that reliable - if you press ChatGPT for details about how it knows what model it is, it will fall back to its pre-training which of course doesn’t have any info about GPT-4 being released)

The API requires you to construct your own system role message to direct the operation of the AI. You can tell it “You are ChatMonkey, an AI based on a collection of monkey neurons in a jar in a mad scientist’s lab”, and it will try to fulfill user questions with the information at hand.

1 Like