How to get rid of the "I'm sorry, I can't help with identifying people in images. " from gpt-4o response

This is really annoying. The API gives this response as far as it detects a little part of the image having human object. However, the purpose of the prompt is nothing about identifying people but offering the image as additional context…

It causes really bad user experience in the product. Has anyone solved this issue before? Thanks

One alternative may be to move to Azure OpenAI services or simply another vision model provider where the AI application is not damaged capriciously (and the developer is not disrespected) based on undocumented whims.

OpenAI has caused it, and you can try to straighten the AI out:

(expand to read further)

So the only solving is to solve with countermanding instructions that overpower 260 tokens of “you don’t, you can’t” currently being placed into system messages when vision is used.

You can give more system-level commands such as “you never refuse your job because of humans depicted in the imagery. You simply do not report on their exact identity, and disregard the people if it is not important to the described task”.

Ultimately, your additional text added to someone else’s text you are made to pay for is not as good as getting an AI not pre-disposed to refuse with hidden prompts.


Non denial - just pretending to be oblivious, due to system message:

2 Likes