Hi everyone, we are proud to present our plugin “CreatiCode Scratch” to the community. This plugin helps ChagGPT to display block-based programs as images and learn to use new blocks in the CreatiCode extensions.
MIT Scratch is the de-facto first programming language for 2D animations for almost every K-12 student today around the world. The CreatiCode platform inherits the simple block syntax and web-based project sharing from MIT Scratch, and further allows students to explore many cool technologies that make learning to code fun and meaningful, such as 3D game engine (based on Babylon.js), Artificial Intelligence (ChatGPT, DALL-E, Speech Recognition, Body/Hand Detection, etc) and Augmented Reality, etc.
Since ChatGPT does not know how to display block-based programs, it usually uses pseudocode to represent Scratch programs. This plugin helps ChagGPT convert these programs into images, which are much easier to read for Scratch leaners and teachers.
In addition, ChatGPT can query this plugin to “learn” how to use newly defined blocks on the spot, and then make use of them to write programs or answer questions.
We expect this plugin to become a great teaching/learning aid for K-12 STEM teachers and students. Here are some example prompts to try it out:
Is there a standard textual syntax for Scratch programs? sb3 files are binary.
There is no standard syntax for Scratch, so when ChatGPT generates pseudocode for Scratch it can use different syntax at different times.
As you said, ChatGPT can’t parse any Scratch project directly, so we believe it has only seen pseudocode on other websites that other people write to represent Scratch. But that should be enough for it to understand how it works.
On top of that, CreatiCode Scratch introduces many new tools, such as blocks for debugging, 3D, AI and AR projects. These are mostly published after the Sep 2021 cutoff, so we have to teach ChatGPT how to use them.