GPT Cursor Control Experiment



So, GPT-4 not only devised the experiment and wrote the code for the interface, but it also successfully controlled a cursor in a gui to accomplish a goal (clicking the yellow square). For anyone interested in intelligent automation, that’s pretty impressive. GPT-4 can draw stuff in a paint program too using cardinal directions and number of pixels. Like “Click and drag to the right 10 pixels”, etc.

2 Likes