Hi folks,
I am working on an Chat application that should include images in the response. Currently I have no idea how to do it, so that it works properly.
These images are stored in a database / on a webserver and can be accessed via an api. The images have additional meta data like description and title.
How can I call the correct image from the webserver during a chat conversation.
e.g. User Entry: … Great, please show me a picture of it
Chat returns the correct image path to the given conext.
Thanks for your ideas
How would you like to fetch the images in conversation? What will user ask about? Like something related to image description and you want to fetch the image that describe the same description?
Can you give me an example conversation between User and Assistant?
Yes sure.
Example:
User: What are the specifications for this flat?
Assistant: The Flat has 3 Rooms. 20 sqm, 40, and 50 sqm .
User: OK. Please show me the floor plan
Assistant: Yes sure: [Imagepath URL]
So, have you stored images for each dimensions or do you want to fetch the image with the closest dimensions matching to 3 Rooms. 20 sqm, 40, and 50 sqm?
If you have images stored for each dimension, then we can achieve this via function calling rather than RAG. I don’t know if RAG would be able to do that but I can achieve this using Function Calling.
OK. Thank you. I´ll have a look at it. 
Any luck if yes would you mind sharing more details?