I’m blind and have already found many awesome uses for ChatGPT since it’s launch, especially once we got image recognition. I’ve used it to help me read product instructions, figure out what color a shirt was, describe a scene and plenty more. While this feature is awesome, it requires taking the pic, uploading it and having ChatGPT process it. Just got the beta version of the iOS ChatGPT app’s new beta video mode and wow! It took it to a new level. It responds to visual questions almost instantly!
A common struggle for me is knowing the color of clothing items, particularly those where I have several colors of the same type of item, like socks or work pants. Aimed the camera at my shelf with my folded work pants, told it I’m looking for the khaki colored chinos and it guided me to the pair I was after. This is incredible!
I write this post both to share the usefulness of this tool for others who might benefit, and also to say, OpenAI please, please, please keep this feature! This is the type of tool where once someone experiences it, there’s no going back. I’m just sitting here now dreaming up all the ways this thing could help me. I could use it to verify that the Uber who pulls up is indeed the right vehicle, help me find the entrance of a building, read a menu at a restaurant and tons of other ideas I probably haven’t even thought of yet.
One application that would be great but that doesn’t currently appear to be supported is helping me frame a shot for a photo. I have the ChatGPT app’s options set so I can use it in the background, but when I share video with ChatGPT and then flip over to the Camera app, the chat session crashes, likely because two things are now trying to access the camera at once. It would be great if you added a “take still image” button or something, right in the app, so users could snap a photo of whatever ChatGPT was seeing. That way, it could help me line up the shot and I could take the pic, right there. Otherwise, looking forward to when the screen share feature gets fully working, as I could just share the camera app with it and it could guide me from there.
Keep up the great work – this tech has a real and massive impact on peoples’ lives.