Integrate ChatGpt with image reading and calculations into website where users can submit image for analysis

With the help of ChatGPT, I’ve developed a process that lets me upload an image with 15 different data fields, ChatGPT extracts the data and then performs a complicated calculation to come up with a number that defines the difficulty of the pattern the image represents.

Right now I have to login to my ChatGPT and upload the images myself.

I want to integrate my ChatGPT evaluation tool defined above into a website where users can upload their own images for analysis to get their difficulty number.

I’m an industrial capital project manager and have zero background in doing this type of integration.

Any help would be greatly appreciated.

Hi @mundt53 and welcome to the forums!

I would suggest using APIs for this. So on your website, you will presumably have the upload button. From there it’s a matter of converting that image into a base64 encoding and passing that encoding (along with your prompts that guide the calculation), to the vision API.

I would suggest looking through these docs to get a sense of how this works.

I would then pair this with Structured Outputs, so you obtain a nice deterministic output that you can then display back to your user.

I hope this helps, and if you get a bit further along and need more help, just let us know!

1 Like

Thanks for the help!

I’ll take a look at the documentation you suggested and get back if I have any questions.

Have a great weekend!

1 Like