Why is it that DALL-E can't write?

[trenton.dambrowitz]

Dall-E is sooo bad at recognizing letters and numbers - any advice?

It’s quite difficult to explain why this isn’t how diffusion models work without giving people (and myself!) a headache, but I think understanding how these tools work is extremely important. Here’s my mildly-informed attempt at explaining it: DALL·E is not a multi-modal large language model. It does not reason or plan. Its sole job is to try to denoise a bunch of pixels to create an image based on the text prompt it was given. [image] It is not a graphic designer, or a skilled artist dra…

As @EricGT said the research paper explains it best, but I’ve tried in a different topic to explain it as well.