How to send image to GPT Action and send image from Action to user

GPT builders Plugins / Actions builders
, ,
1

Say I want to allow user to upload image to ChatGPT and then ask to send the image to the GPT Action service, is that possible?

Say I want another user to be able to ask for the image uploaded to the action service, is that possible?

4 Likes
2

Don’t want this thread to die silently, any one has figured it out?

3

No, it’s not possible. The size of any meaningful image would blow out the maximum request size for Actions.

4

Can I send only the image URL of user upload to the Action?

5

Currently just to observe the workability of the system, i am working with URL’s , so i prompt the user to give me an image url, its a useless hack, but i am hoping it would get solved in eventuall releases, as Assistant API does give u files uploaded to it

2 Likes
6

If the url of the uploaded image can be sent to the actions, this will make lots of applications. I’m waiting for it.

1 Like
7

How are such gpts implemeted, the Logseq OCR extracts text from the uploaded images.

1705923416639
17059234166391608×926 146 KB

8

Hi, I have created a custom GCP function to upload the image to some 3rd party server and then send the URL of that image as the response. It works quite well. The image will be displayed in the chat not as a link.

1 Like
10

Hello, futureofworkchannel, could you please explain how have you achieved this?
Does your custom GPT automatically uploads an image to some 3rd party server, right?
Could you please explain more details.
I am actually interested in how could I make GPT to share DALLE generated images with my server via Actions or any other working way. Thanks!

11

I think my usecase i different as in my case an API is generating base64 formated image. The issue is that OpenAI doesn’t recognise the format and start analizing it as text (that’s very bad design by OpenAI). The work around was a intermediate server that will take the image save, upload it to third party hosting and return URL. But i doubt that you can take Dalle image and upload it or take it as input for the API. To do that ypu would need to build something on the top of the browser or webpage. But you can also use OpenAI API to generate images.

1 Like
12

once these GPTs can pull images from URLs … you are golden! good luck!

1 Like