Cost and Time per Usable Output

Models under test

Models are compared only within their cohort: video (WAN 2.2 Turbo, Veo 3.1); image (Flux 1.1 Pro, Nano Banana, Nano Banana 2, Nano Banana Pro). Cross-cohort rankings are prohibited by the protocol.

Metrics

Results — not yet published

This study publishes no scores until every preregistered run is complete, both blinded raters have scored every output, and two reviewers have signed off. When that happens the summary tables and the full raw run data will appear here — including failure rates and rater disagreement, not just the winning numbers.

Frozen prompt set: text-to-video-2026-q3-v1

All 20 text-to-video prompts, frozen 2026-08-13 at version 2026-q3-v1. Every model runs every prompt 3 times. Download as JSON.

1. 01Wide static shot of a red paper boat crossing a shallow rain puddle from left to right while concentric ripples spread behind it; overcast daylight, realistic motion, no camera movement.
2. 02A ceramic mug on a wooden table releases one continuous ribbon of steam while morning sunlight moves softly across the background; locked camera, realistic materials.
3. 03Tracking shot beside an adult cyclist riding at a steady pace along a quiet coastal road; ocean remains on frame left, smooth forward motion, natural daylight.
4. 04A yellow umbrella opens once in the center of an empty gray plaza as light rain falls vertically; medium shot, fixed camera, realistic fabric motion.
5. 05Macro shot of three clear ice cubes dropping one after another into sparkling water; visible splash, accurate refraction, high-speed commercial lighting.
6. 06An unbranded silver watch rotates exactly one half turn on a black pedestal; slow camera push, controlled studio reflections, dark neutral background.
7. 07An adult dancer performs one clockwise spin and stops facing camera in a sunlit rehearsal room; full body remains visible, steady wide shot.
8. 08A small white dog runs toward camera across short green grass while two soap bubbles drift upward behind it; low camera, natural afternoon light.
9. 09A commuter train enters an outdoor station from frame right and stops beside the platform; wide architectural shot, cloudy daylight, no people crossing the tracks.
10. 10Overhead shot of four strawberries falling into a bowl of milk one at a time; clean white set, crisp splashes, camera remains centered.
11. 11A stack of five unbranded gift boxes collapses gently from top to bottom on a pastel blue studio floor; fixed three-quarter view, soft shadows.
12. 12An adult chef slides one finished plate across a stainless counter and places a green herb garnish at the center; medium shot, warm kitchen light.
13. 13Time-lapse style shot of a single sunflower opening against a plain dark background; bloom stays centered, stem remains stable, no camera motion.
14. 14A clear glass perfume bottle rises slowly through shallow pink mist and stops above a mirrored surface; symmetrical product shot, soft backlight.
15. 15An adult hiker in a red jacket walks from foreground to a distant overlook and pauses; wide landscape, misty mountain layers, slow crane upward.
16. 16Two blue marbles roll down separate wooden tracks, cross at the center without colliding, and exit opposite sides; overhead view, even light.
17. 17A paper airplane flies through a bright office from left to right and lands on an empty desk; continuous shot, gentle handheld camera.
18. 18An orange tabby cat reaches once toward a hanging feather toy and returns its paw to the floor; medium close-up, soft window light.
19. 19Night exterior of a small corner shop as its warm sign turns on and one bicycle passes in front; fixed street-level camera, light rain reflections.
20. 20A translucent blue sneaker rotates slowly above a brushed metal plinth while a narrow light sweep travels from toe to heel; premium studio commercial, no text or logo.

Frozen prompt set: image-adherence-2026-q3-v1

All 20 text-to-image prompts, frozen 2026-08-13 at version 2026-q3-v1. Every model runs every prompt 3 times. Download as JSON.

1. 01Studio photograph of exactly three unbranded glass bottles: one cobalt, one amber, and one clear, arranged left to right on a white plinth; no other bottles, text, or logo.
2. 02Top-down photograph of a red notebook centered between two black pencils that remain parallel to each other; pale gray desk, hard morning shadow.
3. 03A square room with one moss-green chair in the back-left corner and one round white table in the front-right corner; straight architectural lines.
4. 04Editorial portrait of one synthetic adult wearing a yellow raincoat and holding a closed blue umbrella in the right hand; plain gray background.
5. 05Minimal poster with a black background and one centered white headline reading exactly MADE FOR MOTION; no other words, marks, or logos.
6. 06Product photograph of a translucent orange sneaker facing left on a brushed aluminum plinth; warm gray background, softbox from camera right.
7. 07Overhead food photograph containing exactly four blood-orange halves and six dark cherries on pale travertine; no utensils, hands, or text.
8. 08Wide illustration of a lighthouse on the far right of a rocky island with a small red boat on the far left; blue hour, calm ocean.
9. 09Close photograph of two silver rings placed inside a small open navy box; one ring vertical and one ring flat, soft cream background.
10. 10A white ceramic robot with a square head raises its left arm while standing beside a waist-high blue cube; clean studio, full body visible.
11. 11Fashion photograph of two synthetic adults wearing matching charcoal suits, standing back to back under one circular ceiling light; symmetrical framing.
12. 12Flat vector icon sheet containing exactly six fruit icons in a 3 by 2 grid: apple, pear, orange, lemon, cherry, strawberry; white background.
13. 13Photorealistic red bicycle leaning against a yellow wall, front wheel turned slightly right; one green plant pot at frame left and no people.
14. 14Packaging mockup with one blank ivory skincare tube and one blank amber jar on a pale sage surface; soft shadows, no label text or logo.
15. 15A nighttime street with three illuminated windows on the left building and two on the right building; one cyclist crossing the center.
16. 16Macro photograph of one blue eye reflected in a circular silver mirror held by a hand; black background, crisp eyelashes, no extra eyes.
17. 17A wooden shelf with exactly five books ordered by height from shortest on the left to tallest on the right; neutral studio light.
18. 18Isometric illustration of a tiny greenhouse containing two plant beds and one central path; transparent roof, muted green palette.
19. 19Commercial photograph of a clear sparkling-water can covered in condensation, centered on pink acrylic with one lime wedge behind it; no text.
20. 20A four-panel comic arranged in a 2 by 2 grid showing the same small white dog finding a red ball; consistent collar and room in every panel, no captions.