Assistant API: Can Assistant API response with the image url in the message content?

I am working with content messages structured like the example below:

[
  {
    type: 'image_url',
    image_url: {
      url: 'https://f19-zpc.zdn.vn/jpg/***.jpg',
      detail: 'low'
    }
  }
]

Then I send a message like:
“Give me the source URL of the image I have sent”,
but the assistant is unable to respond properly to this request.

What I expect is for the assistant to access or reference the image URL from the message content and return it. However, it either fails to respond or doesn’t recognize that an image was provided via image_url. I need help ensuring the assistant can parse and return the actual URL from such content inputs.

Why assistant can read the content in the image url but can not response that url.

You should add it to your prompt information as well then you will have no problem.

1 Like