Image-Model Prompt Adherence Test

Models under test

Metrics

Results — not yet published

This study publishes no scores until every preregistered run is complete, both blinded raters have scored every output, and two reviewers have signed off. When that happens the summary tables and the full raw run data will appear here — including failure rates and rater disagreement, not just the winning numbers.

Frozen prompt set: image-adherence-2026-q3-v1

All 20 text-to-image prompts, frozen 2026-08-13 at version 2026-q3-v1. Every model runs every prompt 3 times. Download as JSON.

1. 01Studio photograph of exactly three unbranded glass bottles: one cobalt, one amber, and one clear, arranged left to right on a white plinth; no other bottles, text, or logo.
2. 02Top-down photograph of a red notebook centered between two black pencils that remain parallel to each other; pale gray desk, hard morning shadow.
3. 03A square room with one moss-green chair in the back-left corner and one round white table in the front-right corner; straight architectural lines.
4. 04Editorial portrait of one synthetic adult wearing a yellow raincoat and holding a closed blue umbrella in the right hand; plain gray background.
5. 05Minimal poster with a black background and one centered white headline reading exactly MADE FOR MOTION; no other words, marks, or logos.
6. 06Product photograph of a translucent orange sneaker facing left on a brushed aluminum plinth; warm gray background, softbox from camera right.
7. 07Overhead food photograph containing exactly four blood-orange halves and six dark cherries on pale travertine; no utensils, hands, or text.
8. 08Wide illustration of a lighthouse on the far right of a rocky island with a small red boat on the far left; blue hour, calm ocean.
9. 09Close photograph of two silver rings placed inside a small open navy box; one ring vertical and one ring flat, soft cream background.
10. 10A white ceramic robot with a square head raises its left arm while standing beside a waist-high blue cube; clean studio, full body visible.
11. 11Fashion photograph of two synthetic adults wearing matching charcoal suits, standing back to back under one circular ceiling light; symmetrical framing.
12. 12Flat vector icon sheet containing exactly six fruit icons in a 3 by 2 grid: apple, pear, orange, lemon, cherry, strawberry; white background.
13. 13Photorealistic red bicycle leaning against a yellow wall, front wheel turned slightly right; one green plant pot at frame left and no people.
14. 14Packaging mockup with one blank ivory skincare tube and one blank amber jar on a pale sage surface; soft shadows, no label text or logo.
15. 15A nighttime street with three illuminated windows on the left building and two on the right building; one cyclist crossing the center.
16. 16Macro photograph of one blue eye reflected in a circular silver mirror held by a hand; black background, crisp eyelashes, no extra eyes.
17. 17A wooden shelf with exactly five books ordered by height from shortest on the left to tallest on the right; neutral studio light.
18. 18Isometric illustration of a tiny greenhouse containing two plant beds and one central path; transparent roof, muted green palette.
19. 19Commercial photograph of a clear sparkling-water can covered in condensation, centered on pink acrylic with one lime wedge behind it; no text.
20. 20A four-panel comic arranged in a 2 by 2 grid showing the same small white dog finding a red ball; consistent collar and room in every panel, no captions.