Collection of GPT-image-generator 2.0 issues, bugs, and work-around tips (check first post)

Yes, the problem with telling the model to correct something or avoid making a certain mistake often isn’t about following instructions. If the errors are caused by limitations of the model itself, they can’t simply be fixed with a prompt. It’s like telling a person, “Be better at mathematics.” If they don’t know mathematics, the instruction alone won’t help.

What you’re actually doing when you ask the model to improve something is directing more of its attention to that particular aspect. Ironically, this can sometimes lead to overcompensation, causing new problems to appear elsewhere in the image.

One technique that can help is repeating the most important parts of a prompt, either verbatim or with only slight variations. Since the order of the prompt also influences the result, you can even repeat those key instructions near both the beginning and the end of the prompt.

These systems have become remarkably efficient in a very short time, but they are still not perfect. It’s similar to many engineering problems, the last 10% of quality often requires as much time and effort as the first 90% that builds the basic foundation. This is especially true for photorealistic images, where people have almost no tolerance for errors. Achieving those final 10% of realism requires a great deal of additional development.

From what has been officially said about version 2.0, one of the main goals was to make the model faster and more efficient, allowing it to generate images with less computational power. In some situations, that optimization may come at the cost of image quality-particularly in the cases where those final 10% make all the difference.

Topology is especially challenging because it requires an understanding of the image as a whole rather than just its individual parts. That kind of global reasoning is exactly where neural networks become computationally expensive and resource-intensive.

It seems I didn’t make myself clear - I’m sorry, let me be more precise :cherry_blossom:

For a start, I completely agree with you on this

This was just a example of my assumption as to where the deeper challenges might stem from:

Surrealist works, for example, are highly rewarded.

My aim was not to play around with vague terms – but to use scientific terminology with a clear classification framework.

I agree!

What you’re describing here

can also be observed in other fields.

A red kite has a distinctive fork in its tail feathers. That is why experts also refer to it as the ‘fork-tailed kite’. However, the models do not generate a red kite, but only a “bird of prey type”.

Unless the Latin term “milvus milvus” is used.

Here is the link to my post

Another example was that, a year ago, DALL-E could not generate roses, but by using an explicit botanical term for a specific rose, the image could be generated.

Here is the link to my post

@Daller You might still remember?

Since you’re specifically referring to ‘Anatomy’ here:

I have written about a hypothesis, here is the link as well

I agree with you 1000% on this, and I’ll take it a little step further .. by saying that this applies not only to human anatomy but also to structural differentiation.

Yes, I can remember. Once people had finally figured out which words triggered the blocking of an overly simple security system, they were able to bypass it by replacing those words with alternatives that had the same meaning. (All the Disney triggers…)

The vocabulary an image generator understands has a lot to do with image captioning, recognizing what is visible in a training image, identifying the objects, and separating them from their surroundings. The more words/tokens the system understands, the more extensive the possibilities become, for example to request specific species. If the training is precise and extensive enough, it is possible to retrieve a very specific species of rose.

All needs some experiments and try&error.

I spent some time trying to find out how many species the system had been trained on. Sometimes you can find gaps or errors. Here is another old article where the system confused a flower with a bird during training.

Or here, a description of a moon phase was not in training.

Or here a other example of limits caused from training.

I just saw this tweet from Peter Bakkum that the team is working on the noise issue.

I have seen many images “in the wild” with the typical pattern.
All AI trainers must implement filters to prevent them from becoming part of the training data, or it will continue to spread.
(hope he know this site.)