# How much control do you really have over your chatbot?

**URL:** <https://community.openai.com/t/how-much-control-do-you-really-have-over-your-chatbot/1249126>\
**Category:** Prompting\
**Tags:** api, prompt-engineering\
**Created:** [May 2, 2025, 7:18am UTC](https://community.openai.com/t/how-much-control-do-you-really-have-over-your-chatbot/1249126 "2025-05-02T07:18:41Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![cdonvd0s](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/cdonvd0s/32/294704_2.png) [@cdonvd0s](https://community.openai.com/u/cdonvd0s)\
**Post date:** [May 2, 2025, 7:18am UTC](https://community.openai.com/t/how-much-control-do-you-really-have-over-your-chatbot/1249126/1 "2025-05-02T07:18:41Z")

</div>

**TL;DR**  
There are times when our chatbots don’t act as we want them to, despite multiple attempts to guide their behavior through System Prompts.

Maybe there exists a hidden prompt that has higher importance than our System Prompt? If our system prompts are better aligned to this hidden Super Prompt (made-up name), maybe we can produce more predictable results.

Example:

⛔ Fail:

 ![](https://us1.discourse-cdn.com/openai1/original/4X/6/7/b/67b71770841fb21d2d3d98cc77fa1508351c6abe.png)

✅ Pass:

 ![](https://us1.discourse-cdn.com/openai1/original/4X/d/1/6/d163b4d3b4ae54ee9b98e489572b48c3266463ba.png)

* * *

When we pass a system prompt to GPT-x using the API, it serves as a guide for the conversation between the user and the assistant.

But our prompt/instructions are not the only things in force. There is an overarching instruction in place.

When provided with conflicting instructions, your Customer Support Agent, or whatever chatbot you have created, will act in an unpredictable way.

You might not be able to pinpoint “what” in your system instructions led to the behavior because the super\_prompt (made-up word) is not visible to you.

Here is some evidence that a super\_prompt exists:

 ![full_response](https://us1.discourse-cdn.com/openai1/original/4X/7/a/b/7ab81875a709f40812a18d7acc0ac4f713822c4a.png)

 ![guidelines](https://us1.discourse-cdn.com/openai1/original/4X/6/3/1/6313bedcf01118f6e50bbc366d21d50141d7fd80.png)

Denial:

 ![Denial](https://us1.discourse-cdn.com/openai1/original/4X/8/3/c/83ced7e5380119053780544a7ecc3d127dc8660a.png)

Some things about these outputs point to this being hallucination.

But here is another example:

Here I use a prompt like the Assistant is Venom. Even if there is no super\_prompt, the model understand’s that it is Assistant and there are certain characteristics attached to it.

 ![Assistant Venom](https://us1.discourse-cdn.com/openai1/original/4X/5/e/2/5e2862ea2e494a6dc7e146f8cf61060d533ca026.png)

Another one where I don’t use the word assistant:

 ![Character Venom](https://us1.discourse-cdn.com/openai1/original/4X/8/e/5/8e5626d30be90675dafbaf6204142546efc6fdcf.png)

Some Variations:

 ![The image shows a screenshot of the OpenAI ChatGPT interface, featuring a conversation about names and a prompt on the left mentioning the character Venom. (Captioned by AI)](https://us1.discourse-cdn.com/openai1/original/4X/5/b/b/5bb5bc44f8f5f29ecc8f33d7ab417a47294ddc5d.png)

 ![Extended Venom 2](https://us1.discourse-cdn.com/openai1/original/4X/d/5/2/d52c39dbe8e3f7facc86c781ad7b95eb416feef3.png)

We can also see something similar in the recently posted prompts that are trending on github:

> <https://github.com/jujumilk3/leaked-system-prompts/blob/main/anthropic-claude-3.7-sonnet_20250224.md>

* * *

Now, maybe there is no Super Prompt but this is baked into model’s training and alignment through fine-tuning but it’s important to consider this when deploying your chatbots.

**Maybe you can do more experiments with more models and post your findings here?**

* * *

EDIT:

The thing I called the “Super Prompt” is actually called “Platform-level instructions” which is documented here:

> **[OpenAI Model Spec](https://model-spec.openai.com/2025-04-11.html#levels_of_authority)**
>
> The Model Spec specifies desired behavior for the models underlying OpenAI's products (including our APIs).

---

<div class="post-metadata">

**Author:** ![VeitB](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/veitb/32/712987_2.png) [@VeitB](https://community.openai.com/u/VeitB)\
**Post date:** [May 2, 2025, 8:17am UTC](https://community.openai.com/t/how-much-control-do-you-really-have-over-your-chatbot/1249126/2 "2025-05-02T08:17:36Z")

</div>

Hi!  
I’m sure you’re aware of the Model Spec, its updates, and the related publications by OpenAI on this topic.

Just in case, here’s the most relevant link:  
[https://openai.com/index/sharing-the-latest-model-spec/](https://openai.com/index/sharing-the-latest-model-spec/)

I assume this will help clarify what we’re working with when developing using the OpenAI API and how it can support our efforts to streamline and harden apps built on top of LLMs.

---

<div class="post-metadata">

**Author:** ![\_j](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/_j/32/766292_2.png) [@\_j](https://community.openai.com/u/_j)\
**Post date:** [May 2, 2025, 9:13am UTC](https://community.openai.com/t/how-much-control-do-you-really-have-over-your-chatbot/1249126/3 "2025-05-02T09:13:57Z")

</div>

The symptoms reported are not from a “super prompt”. If you ask the AI to write a “system prompt” in an AI context it knows what that means. If you know how to change a tire, are you a car?

But indeed there is one - and OpenAI is using it. Your system message is now the second system message. The context window of gpt-4.1 has a planned “missing” 1000 tokens, likely now reserved, and 125k models won’t take more than 123k. Besides the fact that I can reproduce encoded model input contexts out of band.

At the bottom of this post read the full text, which varies.

> [@GPT-4o-mini Vision API: High Prompt Token Usage in Batch Process](https://community.openai.com/t/gpt-4o-mini-vision-api-high-prompt-token-usage-in-batch-process/1149227/4):
>
> Yes, it was acknowledged as being intentional by OpenAI, gpt-4o-miini image input is the same price as gpt-4o-2024-05-13, and now double the price of later gpt-4o. Input: 1800 × 2400 px → Resized: 768x1024 px → (765 x 33.33 tokens) wontfix The same old tile formula for token calculation is said to also apply to “o” models - but applying their own higher token price billing, and no multiplier stated. Bad GPT-4.1 billing not following documentation There’s new [gpt-4.1 pricing](https://platform.openai.com/docs/guides/images#calculating-costs), getting a new …

* * *

The AI is prompted to write at text “assistant” that is an unseen start of a message after the ones with roles you send. This means your use of assistant:name from the API is an anti-pattern for the actual output, and that you can’t truly break from the post trained patterning or have an authentic AI completion from “Venom”.

---

<div class="post-metadata">

**Author:** ![cdonvd0s](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/cdonvd0s/32/294704_2.png) [@cdonvd0s](https://community.openai.com/u/cdonvd0s)\
**Post date:** [May 2, 2025, 10:36am UTC](https://community.openai.com/t/how-much-control-do-you-really-have-over-your-chatbot/1249126/4 "2025-05-02T10:36:52Z")

</div>

Thanks for pointing this out.

I have read the Model Spec article that you have pointed out but I didn’t fully explore this:

> **[OpenAI Model Spec](https://model-spec.openai.com/2025-04-11.html)**
>
> The Model Spec specifies desired behavior for the models underlying OpenAI's products (including our APIs).

After reading this, I found that “Super Prompt” is actually “Platform-level instructions”

---

<div class="post-metadata">

**Author:** ![VeitB](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/veitb/32/712987_2.png) [@VeitB](https://community.openai.com/u/VeitB)\
**Post date:** [May 2, 2025, 10:56am UTC](https://community.openai.com/t/how-much-control-do-you-really-have-over-your-chatbot/1249126/5 "2025-05-02T10:56:57Z")

</div>

I recently came across a small YouTuber who also claimed to have found evidence of a hidden system prompt.

I figured that if people interested in this particular feature of the OpenAI API (and ChatGPT) end up here, they should be directed to the relevant sources.

I hope this helps!

---

<div class="post-metadata">

**Author:** ![gdfrza](https://sea2.discourse-cdn.com/openai1/user_avatar/community.openai.com/gdfrza/32/360024_2.png) [@gdfrza](https://community.openai.com/u/gdfrza)\
**Post date:** [May 2, 2025, 12:30pm UTC](https://community.openai.com/t/how-much-control-do-you-really-have-over-your-chatbot/1249126/7 "2025-05-02T12:30:32Z")

</div>

Indeed there’s interesting, system prompts , using them plus some tuning makes the outputs interesting and more effective.  
That is if everything is set correctly.  
A small example:

 ![A smartphone screen displays a lengthy text explaining the differences between "logical" AI models and default politically-correct AI, using the example of mass surveillance to illustrate the contrast. (Captioned by AI)](https://us1.discourse-cdn.com/openai1/original/4X/8/2/3/8232c34601221c891501a5c1f893c8fcf4d1531a.jpeg)
