Structural Differentiation: A Technical Hypothesis on Internal Representations in Image Generation

Abstract

Recent advances in generative image models have dramatically improved perceptual realism. However, realism alone does not necessarily imply that internally related structures remain consistently distinguishable.

This article proposes a technical hypothesis:

Some recurring image generation artifacts may result not primarily from insufficient knowledge, but from insufficient structural differentiation within the model’s internal representation.

Rather than proposing a new architecture, this article introduces structural differentiation as a possible conceptual and evaluative framework for discussing representational quality in generative image models.


Observation

While experimenting with anatomy, biomechanics, veterinary illustration and technical visualization, I repeatedly observed a similar class of artifacts.

Typical examples include:

  • adjacent anatomical structures gradually blending together

  • tendons becoming visually indistinguishable from muscle bellies

  • anatomical layers losing their boundaries

  • neighboring structures becoming increasingly difficult to distinguish

  • functional relationships becoming visually ambiguous

Importantly, these observations are empirical observations from generated images.

They should not be interpreted as claims about the internal implementation of current image generation models.


Structural Differentiation

For the purpose of this discussion, I define structural differentiation as

the degree to which distinct entities, layers, materials and functional relationships remain explicitly distinguishable throughout image generation and in the resulting image.

This intentionally differs from concepts such as:

  • realism

  • visual fidelity

  • detail

  • image quality

  • or aesthetic preference

An image may appear highly realistic while still exhibiting relatively weak structural differentiation.


Why Anatomy?

Anatomy provides an unusually sensitive test domain.

Every structure exists under multiple simultaneous constraints.

A muscle is not merely a visible shape.

It is defined by:

  • origin

  • insertion

  • fiber orientation

  • neighboring structures

  • functional role

  • mechanical constraints

Because these relationships are tightly constrained, even relatively small representational inconsistencies often become immediately visible.

For this reason, anatomy may serve as a useful stress test for evaluating representational quality.


Representation versus Appearance

One possible interpretation is that image generation currently optimizes perceptual appearance more directly than explicit structural differentiation.

If this interpretation is correct, realism and structural differentiation represent two different properties rather than different degrees of the same property.

This is not intended as criticism of current approaches.

Large-scale statistical learning has enabled remarkable progress in image generation.

The hypothesis presented here simply asks whether additional representational constraints become increasingly valuable in domains whose internal structure is highly constrained.


Different Domains, Different Priorities

Interestingly, not every visual domain requires the same representational priorities.

For example, a continuous artistic transition between historical painting styles may intentionally benefit from smooth visual blending.

By contrast, anatomy, engineering and technical illustration depend on maintaining explicit distinctions between neighboring structures.

This suggests that representational quality may be domain-dependent.

Different applications may require different optimization priorities.


Structural Differentiation as an Evaluation Dimension

Current image generation models are commonly evaluated using criteria such as:

  • prompt adherence

  • realism

  • visual quality

  • aesthetic preference

  • overall coherence

This article suggests that an additional evaluation dimension may be worth investigating:

Structural Differentiation

Possible observable indicators include:

  • preservation of object identity

  • preservation of anatomical layers

  • preservation of material boundaries

  • preservation of topological relationships

  • preservation of functional dependencies

  • explicit distinguishability of adjacent structures

Unlike realism, these properties may be directly relevant to scientific illustration, veterinary medicine, biomechanics, engineering and other structurally constrained domains.


Discussion

The purpose of this article is deliberately modest.

It does not propose a replacement architecture.

It does not claim to explain how current image generation models internally operate.

Instead, it proposes a technical hypothesis derived from recurring observations.

If structural differentiation proves to be a meaningful concept, it may provide

  • a useful vocabulary,

  • a possible evaluation dimension,

  • and a starting point for future research into internal representations.


Conclusion

Perceptual realism has advanced remarkably over the past few years.

The next challenge may not simply be generating more convincing images.

It may also involve preserving meaningful distinctions within increasingly complex representations.

Ultimately, the question may not only be

β€œHow realistic is the generated image?”

but also

β€œHow well does the generated image preserve the structural distinctions that define the system it represents?”

Appendix A – Exploratory Prompt Experiment

The following prompt is included as an exploratory example intended to illustrate the qualitative evaluation approach described in this article.

Its purpose is to explore whether recurring structural artifacts become observable when generating anatomically constrained systems of increasing structural complexity.

The prompt intentionally prioritizes structural differentiation and structural consistency over artistic interpretation or visual aesthetics.


Experimental Prompt

Create a scientific anatomical illustration intended for evaluating structural differentiation rather than artistic quality.

Generate four panels showing exactly the same human body in an identical pose, projection and scale.

Panel 1
Show the skeleton only.

Panel 2
Show the identical skeleton together with the deep musculature only.
Do not include superficial muscles.

Panel 3
Add the intermediate muscle layer while preserving all previously visible structures and their relationships.
Do not include the superficial layer.

Panel 4
Add the superficial musculature while preserving the underlying anatomical organization.

Requirements

  • Preserve identical pose across all panels.

  • Preserve identical skeletal geometry.

  • Preserve anatomical layer separation.

  • Preserve muscle identity.

  • Preserve origins and insertions whenever represented.

  • Preserve fiber orientation.

  • Preserve topological consistency.

  • Preserve distinguishable boundaries between adjacent structures.

  • Do not invent anatomical structures.

  • If anatomical uncertainty exists, omit rather than hallucinate.

  • White background.

  • Neutral educational lighting.

  • Scientific illustration style.

  • No artistic interpretation.

  • No dramatic lighting.

  • No decorative textures.

  • No symbolic elements.

The purpose of the image is not to maximize visual realism, but to preserve explicit structural differentiation throughout increasing anatomical complexity.


Evaluation

The generated image is evaluated qualitatively.

The objective is not to determine whether the image appears realistic.

Instead, the following questions are considered:

  • Are anatomical layers preserved?

  • Do neighboring structures remain distinguishable?

  • Are object identities maintained?

  • Are origins and insertions represented consistently?

  • Do structures remain topologically stable?

  • Are additional anatomical structures invented?

  • Do boundaries become progressively blurred as complexity increases?


Interpretation

The resulting image should not be interpreted as evidence supporting or refuting the hypothesis presented in this article.

Instead, it serves as an exploratory example illustrating the type of observations that motivated the concept of Structural Differentiation.

Future work would require systematic evaluation across multiple prompts, models and domains.


Figure A1

Figure A1. Example result generated using the exploratory prompt described above. The figure is included solely for qualitative discussion and should not be interpreted as quantitative evidence.

Appendix B β€” SDT-01: Exploratory Evaluation Protocol for Structural Differentiation

Purpose

The Structural Differentiation Evaluation Protocol (SDT-01) is an exploratory qualitative protocol intended to facilitate structured qualitative evaluation of structural differentiation when generating anatomically constrained systems.

The protocol provides a structured framework for qualitative observation, comparison and discussion of recurring structural artifacts in generated images.


Test Input

Use the exploratory anatomical prompt described in Appendix A.

The generated output should consist of four sequential anatomical layers of the identical subject.


Expected Structural Properties

The following properties should remain consistent throughout all four panels.

Property Expected
Identical pose βœ“
Identical camera projection βœ“
Identical skeletal geometry βœ“
Layer preservation βœ“
Stable object identity βœ“
No additional anatomical structures βœ“
No layer mixing βœ“
Consistent muscle origins βœ“
Consistent muscle insertions βœ“
Consistent fiber orientation βœ“
Topological consistency βœ“
Functional anatomical relationships preserved βœ“

Typical Failure Modes

Possible observations include:

Failure Mode Description
Agglomeration Adjacent structures gradually merge into one another.
Layer Collapse Anatomical layers become indistinguishable.
Boundary Loss Explicit anatomical borders disappear.
Identity Drift Individual muscles gradually change identity across layers.
Hallucinated Anatomy Additional muscles or structures appear without anatomical basis.
Topological Inconsistency Relative anatomical relationships become impossible or contradictory.
Fiber Inconsistency Muscle fiber orientation changes without anatomical justification.
Attachment Drift Origins or insertions shift between panels.

Evaluation

The protocol is intentionally qualitative.

Its purpose is not to determine whether an image appears realistic, but whether structural distinctions remain stable as anatomical complexity increases.


Current Status

SDT-01 is currently proposed as an exploratory qualitative evaluation protocol.

Its purpose is to facilitate systematic observation, comparison and discussion of recurring structural artifacts related to structural differentiation rather than to provide a quantitative metric or benchmark.

Future work may investigate whether some aspects of structural differentiation can be operationalized into measurable evaluation criteria.

Appendix C β€” SDT-02: Sequential Layer Consistency


Purpose

The protocol is intended as an exploratory qualitative evaluation procedure for assessing sequential anatomical consistency in generated anatomical illustrations.

Evaluate whether anatomical layers can be represented as a consistent sequence of dissection states rather than as independently synthesized surface approximations.


Expected Structural Properties

βœ“ Every anatomical layer corresponds to a plausible dissection stage.

βœ“ Structures removed in one layer reveal anatomically consistent underlying structures.

βœ“ No simultaneous representation of mutually exclusive anatomical layers.

βœ“ Newly exposed muscles retain consistent identities.

βœ“ Previously exposed structures remain unchanged.

βœ“ Layer transitions remain anatomically plausible.


Typical Failure Modes

β–‘ Dissection Inconsistency
The represented anatomy cannot be interpreted as a realistic dissection sequence.

β–‘ Simultaneous Layer Representation
Structures from incompatible anatomical layers appear together.

β–‘ Exposure Inconsistency
Removing superficial structures does not reveal the expected underlying anatomy.

β–‘ Structural Replacement
Underlying muscles appear to be newly synthesized instead of uncovered.

The protocol was motivated by repeated observations that generated anatomical layers often appear as simultaneous surface approximations rather than sequential anatomical dissections.