Can Custom GPTs Return Photos to the User?

Our organization is looking into getting ChatGPT Teams in order to create custom GPTs for internal purposes. We already know that if you upload a PDF with text and images, it only references the text and not the image.

But, if we upload an image directly, can it reference that image? Can it also return that image to the user in a response if the question applies to that image?

I did search beforehand, but any relevant posts (that I found) were over a year old and I’m sure a lot has changed in a year.

Thanks :slight_smile:

1 Like

Welcome to the forum it is a lovely rabbit hole :rabbit::hole::infinity::four_leaf_clover:

No it only has dalle and search it can produce web images from searches and dalle generated images but it will not reproduce uploaded images for you.

Dalle can use an image though like “cartoon me” but will not remake the original

3 Likes

Thank you for your response and for the warm welcome :slight_smile:

Is there any way to have it reference a link to a Google doc that has the image? I’m trying to come up with a workaround. Is it also the same for uploaded videos?

2 Likes

No not really it only uses stock stuff.
You could do it with API but that would be expensive.

Link to API dashboard https://platform.openai.com/docs/overview

And front page https://openai.com/index/openai-api/

2 Likes

If you can get your images to the top of the seo it could find them if it’s public but not 100% of the time …

What’s easier is to do a public page and do them as links.
User clicks them and goes to your site.

2 Likes

Thank you for all your help!!

This would be built using internal information, so not for anything found online.

I’m so sorry, the only gpt solution I can think of is a public web page to host the images and the GPT can produce links to them with address.

Like this . The forum is public

1 Like

That’s okay :slight_smile: Better to know up front before we subscribe!!

Sometimes we use Google Sites for internal use, but again it’s not publicly published so I’m guessing it wouldn’t help.

I am out of hearts haha they only give us a limited number each day lol.
I wish you luck . :infinity::four_leaf_clover::infinity::heart:

3 Likes

Here is the result of uploading a ZIP file to code interpreter used by a GPT that you can share a link to. The zip file has numbered images in it.

Limitation: the AI cannot use computer vision to inspect the contents of images itself. Only user uploads along with the input box can be “seen”.

I had not used images in the knowledge base before, but I have now tested uploading two image files as part of the knowledge base.

Uploaded files:

1-

2-

Chat:

1 Like

Yes you can have a text image read and have an image downloadable from knowledge like any knowledge but you cannot have it appear in a gpt session… @_j @polepole

IMO user asked if they can retrieve an image in gpt not download it to a separate system …if code analysis is on you can download any onboard knowledge and I think they need more than 20 download images max…

I mean if they wanted it downloaded they could skip it and do it like a turn the page record “ ok open image y” and you find it and click it skip the download…

1 Like

I’ve met all the qualifications set out: here 120 images to a GPT. Providing any image on demand as a GPT function (and it also was instructed to use coded randomization normally). And displaying:

It is merely developing the framework where 100 images that are about your knowledge can as easily be replayed in a GPT to a user. You just need to up your GPT developer game to make it happen.

1 Like

So you can upload more than 20 files to knowledge @_j to a gpt ?

WTH no back end api?

A single uploaded zip file in a GPT lets the script the AI writes unzip many files from one to the code interpreter mount point for its notebook. This can include a hierarchy, a mapping of image file name or index to information it presents or the placeholder in file search extracted text that refers to the image (because you did your own image extraction beforehand to prepare enhanced knowledge), to then be auto-displayed by Python.

The only limitation is the current GPT AI model’s ability to keep paying attention to more complex instructions.

Yes but they still won’t load in a session just like singles in knowledge., you are doing downloads …

https://help.openai.com/en/articles/8983703-how-many-files-can-i-upload-at-once-per-gpt

See it just artifacts…

1 Like

The GPT pictured has only one zip file as GPT attachment. (1/20).
Then instructions.

Another counterpoint - just using the GPT’s abilities.

The file contents are not “knowledge” - they are in the code interpreter execution environment. You have to make your GPT with a decent understanding of what the Python notebook can do for you and your user.

I can’t get it to show a single image if it is the only thing in knowledge…

Then it’s not permanent you can’t make a custom gpt that does it at hello?

I showed the very first input to the GPT with no user supplementation.

Go request monkeys yourself:

(should be fully-published now)