Why is it that DALL-E can't write?

Why is it that GPT-4 can draw beautiful pictures with an incredible sense of context, and even include signs and words in its drawing, and on the other hand can write so nicely when answering prompts, but can’t, for the life of itself spell the words correctly within its drawings ?

1 Like

Read the research paper, it explains such.

2 Likes

As @EricGT said the research paper explains it best, but I’ve tried in a different topic to explain it as well.

1 Like

But if you place the text in quotes or something, It should have to “think” per see. Just put those elements as is, into the art. COnsider the elements in quotes or brackets an art element, a collection of pixels.

Once again, that’s not really how diffusion models work. It’s a great idea though!

That might be possible as some form of post-processing in the future, but at the moment it’s not feasible with the current models.

2 Likes