GPT-4 via the API not nearly as powerful as GPT-4 on the website

API
1

I’ve developed some prompts on the ChatGPT website which use GPT4’s advanced reasoning abilities, so the prompts only work well with that model.

I’ve just got access to GPT4 in the API , and I’ve discovered that through the API, my prompts work more like GPT3 on the web site (e.g. don’t work nearly well enough to be useful).

Furthermore, GPT4 accessed via the API actually self-identifies as GPT3 if you ask it what version of GPT it is. The website version of GPT4 self-identifies as GPT4.

Does anyone know anything about this situation? And yes, i’m sure I’m actually connecting to GPT4 on the API, here is the example output from asking it to report its GPT version:

{
“id”: “chatcmpl-7rre6cxZITjqb62lhhHstaK3mqPGp”,
“object”: “chat.completion”,
“created”: 1693071954,
“model”: “gpt-4-0613”,
“choices”: [
{
“index”: 0,
“message”: {
“role”: “assistant”,
“content”: “I am powered by OpenAI’s GPT-3.”
},
“finish_reason”: “stop”
}
],
“usage”: {
“prompt_tokens”: 25,
“completion_tokens”: 12,
“total_tokens”: 37
}
}

2

As far as we’re told, any differences to ChatGPT are because your API usage doesn’t come with the specific system prompts and other surrounding mechanisms that OpenAI have built on top of the core model – the core model is the same, and you could achieve similar results using various context and prompting methods.

Also, as far as we’re told, GPT-4 doesn’t know it’s GPT-4, so it’ll answer that it’s 3, unless you tell it otherwise, presumably in the system prompt.

1 Like
3

Thanks for your reply - do we know anything about the “specific system prompts and other surrounding mechanisms” that OpenAI has added on top of the website version of GPT4?

1 Like
4

Try this one:

“content”: “You are the ChatGPT…”

But the api can be much more powerful than ChatGPT using many different prompt techniques like proper use of chain of thought.

2 Likes
5

Did you ever find out anymore info around:

“Thanks for your reply - do we know anything about the “specific system prompts and other surrounding mechanisms” that OpenAI has added on top of the website version of GPT4?”

I get what they are saying and it makes sense, just wanted to know if you ever figured out the workaround!

6

No, I haven’t found any more information about that.

7

You can search the forum for phrases like:

{“role”: “system”, “content”: “You are ChatGPT, a large language model trained by OpenAI, based on the GPT-4 architecture.\nKnowledge cutoff: 2021-09\nCurrent date: 2023-09-23”}

and see if what you find proves useful :stuck_out_tongue_winking_eye:

8

I tried that message but the answer still much different from the website gives!