A new playground with gpt-4-vision model and image inputs

Hi folks, I just updated my product Knit (an advanced prompt playground) with the latest gpt-4-vision-preview model.

Demo:

Features:

  • Multiple image inputs in each user message.
  • Knit handles the image storage and transmission, so it’s fast to update and test your prompts with image inputs.
  • Individual detail parameter control of each image.
  • Token calculation based on image resolution and detail parameter.
  • Setup temperature and other parameters of the 4v model.

All current features of Knit also work smoothly with the new image prompt editor, like: full version control, code export and etc.

Disclaimer: Due to the low daily limit of the 4v api, the new editor is currently only available for Knit Plus/Pro (paid memberships) users.

Let me know if you need any other help on integrating the 4v api!

If you are working on 4v projects, try Knit now: https://promptknit.com

try taking a screenshot of the PDF and uploading that to ChatGPT-4 and then ask about the numebrs.

There can be numerous PDF protections beside the actual contents just being slices of images.

There’s a complement of tools and scripts that can make a PDF readable, but the end-all is Adobe Acrobat Pro’s “enhance scans” to OCR them, which will also pull the text out of healed images and represent it as a font instead of a mere overlay.

Then the file can be text-extracted simply by code interpreter or your own tool similar to what the AI would write to perform the task.

GPT-4-vision will refuse flat-out OCR tasks, but instead will interpret if you want a poem based on your sales figures.

openai.InternalServerError: Error code: 500 - {‘error’: {‘message’: ‘Something went wrong processing one of your images.’, ‘type’: ‘server_error’, ‘param’: None, ‘code’: None}}

After one of those, I got a more cooperative GPT-4AI by API than prior chatbot vision…so there might be hope … perhaps because chatbots don’t like doing your OCR otherwise at 1.5 cents per page

prompt: Transcribe the text within this page.

Input image, PDF screenshot

I’m happy to help. Here’s the transcription of the text within the image:

OCR?
“MAINTENANCE” MENU

MENU > machine settings > maintenance.

To clean all the machine’s internal circuits used for making coffee and milk. Turn the click wheel with your finger to:

maintenance
milk circ. rinse cycle
rinse the milk circuits after making the beverages.

maintenance
milk cleaning cycle
thoroughly clean the milk circuits. This must be performed after a fixed time has elapsed from the first dispensing.

maintenance
coffee cleaning cycle
clean the brew group.

maintenance
descaling cycle
Perform the descaling cycle.

Milk circuit rinse cycle

MENU > machine settings > maintenance > milk circ. rinse cycle

To rinse the machine’s internal circuits used for preparing milk. This short cycle must be necessarily performed after 20 minutes from the last dispensing of a beverage with milk.
If it is not performed, the machine comes to a halt and does not allow the dispensing of milk beverages.

Note: before performing this function make sure that:
1. a large enough container is positioned under the spout;
2. the milk container has been correctly inserted in the machine;
3. the water tank contains a sufficient quantity of water.

1
machine settings
maintenance

MENU

milk circ. rinse cycle

2
maintenance
milk circ. rinse cycle

MENU

3
milk circ. rinse cycle
yes

MENU

milk circ. rinse cycle

4
In Process
milk circ. rinse cycle

MENU

Wait for the cycle to complete.

5
Remove the container, rinse and dry.

AFTER USE, ALWAYS REMOVE THE MILK CONTAINER AND PUT IT IN THE REFRIGERATOR.

The container may be left in the machine only if it has been washed with drinking water and it does not contain milk; see page 38.

Please note that the text follows specific sections and instructions and the transcription includes their arrangement as presented in the image.

Any indication when the per day request limits will be raised?

There’s no officiation announcement on this, but I think it should be soon after they finished the scaling up.