I want to add image support to my project. But it is not image generation. I’d like to be able to upload a picture when talking with an assistant and get comments/feedback or discuss about the image. First I thought I should send the image as a file to a vector store with purpose “assistant” But I…

Hi, you get the second link to this example I wrote 8 hours ago. [image] API Calls to v1/threads/{thread_id}/messages fails with [file] and [file_ids] API Since it is so confusing, here’s a practical example with all types of uploaded files you can put in a me…

@ilkeraktuna as @_j said you can pass images to an assistant as long as that assistant has a vision enabled model selected such as GPT-4o. From your link you sent below the Quickstart it states tha basic rule of thumb. “Images are made available to the model in two main ways: by passing a link to …

[image] carl.g.brown: by passing a link to the image or by passing the base64 encoded image directly in the request Specifically with Assistants, though, BASE64 attachment is not an option, though. You have a different method, which is to upload to storage and then use its file ID.

So does the image still get passed at the message level or could you pass it at the thread level too? I know in the playground passing in the message does not create a vector store, but does create a file id which aligns that it goes directly to file storage.

really ? I had thought the easiest method would be BASE64 so is it not supported on assistants ? But then how to upload it to storage ? I am using java , so I don’t have the fancy and easy python libraries to use. I wrote my own http post method using httpurlconnection for json posting. For fil…

Images are not a document that can be used with vector store and its file_search, which is the only messages file method that has semi-permanent attachment to a thread (that is just a container). Images can be attached to a code interpreter session by message for data processing, but I don’t think t…

So then to upload an image you just use this https://platform.openai.com/docs/api-reference/files and then pass the file id during the message creation as an attachment?

The link in my second post shows how a user message is constructed for computer vision, using a file uploaded to file storage endpoint with the purpose set as “vision” (not “assistants”). Although you can talk about the image like it was an “attachment”, it is not for the API parameter “attachments…

[image] _j: The link in my second post shows how a user message is constructed for computer vision, using a file uploaded to file storage endpoint with the purpose set as “vision” (not “assistants”). Yes this helps. This section also clears up on the library side. Creating image input conten…

[image] _j: The link in my second post shows how a user message is constructed for computer vision, using a file uploaded to file storage endpoint with the purpose set as “vision” (not “assistants”). Although you can talk about the image like it was an “attachment”, it is not for the API parame…

Using images to discuss with an assistant

API

samprita September 12, 2024, 10:35am 15

Please check this thread How to send base64 images to Assistant API? - #5 by _j

Topic		Replies	Views
Chatgpt 4o API For Sending Both PDF and Images API	9	14732	February 12, 2025
Can Assistants API understand image files uploaded? API	11	11980	September 28, 2024
Asisstant API for querying image API	5	565	June 25, 2024
There is no available documentation for the Assistants V2 API Documentation api	10	2960	June 5, 2024
How to send base64 images to Assistant API? API gpt-4 , chat-with-images , assistants-api , gpt-4o	18	33836	September 18, 2024

Using images to discuss with an assistant

Related topics