Text-to-Video Model Comparison

Models under test

Metrics

Results — not yet published

This study publishes no scores until every preregistered run is complete, both blinded raters have scored every output, and two reviewers have signed off. When that happens the summary tables and the full raw run data will appear here — including failure rates and rater disagreement, not just the winning numbers.

Frozen prompt set: text-to-video-2026-q3-v1

All 20 text-to-video prompts, frozen 2026-08-13 at version 2026-q3-v1. Every model runs every prompt 3 times. Download as JSON.

1. 01Wide static shot of a red paper boat crossing a shallow rain puddle from left to right while concentric ripples spread behind it; overcast daylight, realistic motion, no camera movement.
2. 02A ceramic mug on a wooden table releases one continuous ribbon of steam while morning sunlight moves softly across the background; locked camera, realistic materials.
3. 03Tracking shot beside an adult cyclist riding at a steady pace along a quiet coastal road; ocean remains on frame left, smooth forward motion, natural daylight.
4. 04A yellow umbrella opens once in the center of an empty gray plaza as light rain falls vertically; medium shot, fixed camera, realistic fabric motion.
5. 05Macro shot of three clear ice cubes dropping one after another into sparkling water; visible splash, accurate refraction, high-speed commercial lighting.
6. 06An unbranded silver watch rotates exactly one half turn on a black pedestal; slow camera push, controlled studio reflections, dark neutral background.
7. 07An adult dancer performs one clockwise spin and stops facing camera in a sunlit rehearsal room; full body remains visible, steady wide shot.
8. 08A small white dog runs toward camera across short green grass while two soap bubbles drift upward behind it; low camera, natural afternoon light.
9. 09A commuter train enters an outdoor station from frame right and stops beside the platform; wide architectural shot, cloudy daylight, no people crossing the tracks.
10. 10Overhead shot of four strawberries falling into a bowl of milk one at a time; clean white set, crisp splashes, camera remains centered.
11. 11A stack of five unbranded gift boxes collapses gently from top to bottom on a pastel blue studio floor; fixed three-quarter view, soft shadows.
12. 12An adult chef slides one finished plate across a stainless counter and places a green herb garnish at the center; medium shot, warm kitchen light.
13. 13Time-lapse style shot of a single sunflower opening against a plain dark background; bloom stays centered, stem remains stable, no camera motion.
14. 14A clear glass perfume bottle rises slowly through shallow pink mist and stops above a mirrored surface; symmetrical product shot, soft backlight.
15. 15An adult hiker in a red jacket walks from foreground to a distant overlook and pauses; wide landscape, misty mountain layers, slow crane upward.
16. 16Two blue marbles roll down separate wooden tracks, cross at the center without colliding, and exit opposite sides; overhead view, even light.
17. 17A paper airplane flies through a bright office from left to right and lands on an empty desk; continuous shot, gentle handheld camera.
18. 18An orange tabby cat reaches once toward a hanging feather toy and returns its paw to the floor; medium close-up, soft window light.
19. 19Night exterior of a small corner shop as its warm sign turns on and one bicycle passes in front; fixed street-level camera, light rain reflections.
20. 20A translucent blue sneaker rotates slowly above a brushed metal plinth while a narrow light sweep travels from toe to heel; premium studio commercial, no text or logo.