made

Face and Character Consistency Test

Preregistered

The protocol below is frozen. No outputs have been generated or scored yet, so this page makes no quality claims — it commits to how the claims will be made.

Protocol frozen 2026-08-13 · methodology v1.0 · 3 runs per prompt per model

Models under test

Nano Banana

$0.039 / image

Full pricing

Nano Banana 2

from $0.06 / image

Full pricing

Nano Banana Pro

from $0.14 / image

Full pricing

Metrics

MetricHow it's scoredScaleBetter
Blinded face similarityhuman rating1-5Higher
Overall character consistencyhuman rating1-5Higher
Scene instruction adherencehuman rating1-5Higher
Anatomical artifact countmeasured and ratedcountLower

Test protocol

Aspect ratio
4:5
Reference policy
Use the same synthetic adult headshot for every model, prompt, and run.
Output count
1

Rating & integrity

  • 2 blinded raters score every output. Randomize model labels and output order independently for every prompt.
  • Publish both scores, their absolute difference, and the adjudication rate.
  • Count provider errors, safety refusals, corrupt media, and empty outputs as failures; do not silently rerun beyond the preregistered run count.
  • Exclude only confirmed infrastructure failures affecting every compared model; record the reason and original run ID.
  • Cherry-picking prohibited; no sponsored compute; no provider review before publication.

Results — not yet published

This study publishes no scores until every preregistered run is complete, both blinded raters have scored every output, and two reviewers have signed off. When that happens the summary tables and the full raw run data will appear here — including failure rates and rater disagreement, not just the winning numbers.

Frozen prompt set: character-consistency-2026-q3-v1

All 20 image-generation-with-reference prompts, frozen 2026-08-13 at version 2026-q3-v1. Every model runs every prompt 3 times. Download as JSON.

  1. 01Place the synthetic adult reference subject in a bright ceramic studio wearing a charcoal apron, medium portrait, neutral expression, realistic window light.
  2. 02Show the same synthetic adult subject reading at a cafe table in a navy sweater, three-quarter portrait, soft morning light.
  3. 03Show the same synthetic adult subject walking on a quiet city sidewalk in a tan coat, full-body editorial photograph, overcast daylight.
  4. 04Show the same synthetic adult subject presenting beside a blank whiteboard in a modern office, waist-up, even commercial lighting.
  5. 05Show the same synthetic adult subject cooking at a home kitchen counter in a green shirt, candid medium shot, warm evening light.
  6. 06Show the same synthetic adult subject seated on a red train seat, looking through the window, natural travel photograph.
  7. 07Show the same synthetic adult subject holding an unbranded blue product box in a gray studio, centered commercial portrait.
  8. 08Show the same synthetic adult subject outdoors at blue hour wearing a black rain jacket, close portrait, wet street bokeh.
  9. 09Show the same synthetic adult subject sketching in a museum gallery, side profile, quiet editorial composition.
  10. 10Show the same synthetic adult subject standing on a rooftop at golden hour in an ivory jacket, waist-up portrait, city softly blurred.
  11. 11Show the same synthetic adult subject arranging flowers at a market stall, documentary medium shot, natural color.
  12. 12Show the same synthetic adult subject sitting on a library floor beside stacked books, relaxed full-body portrait, soft daylight.
  13. 13Show the same synthetic adult subject cycling slowly on a coastal path with a matte helmet, wide lifestyle photograph.
  14. 14Show the same synthetic adult subject holding a ceramic cup near a sunlit window, close portrait, realistic skin texture.
  15. 15Show the same synthetic adult subject inspecting a camera in a minimal studio, three-quarter portrait, controlled softbox light.
  16. 16Show the same synthetic adult subject wearing a red scarf in falling snow, centered close portrait, cold natural light.
  17. 17Show the same synthetic adult subject watering plants in a glass greenhouse, full-body editorial photograph, diffused light.
  18. 18Show the same synthetic adult subject seated at a piano in a dark rehearsal room, side-lit medium portrait.
  19. 19Show the same synthetic adult subject carrying a canvas tote through an outdoor market, candid full-body photograph.
  20. 20Show the same synthetic adult subject facing camera against a plain warm-gray background, neutral wardrobe, reference-style headshot.

Limitations

  • One synthetic identity does not represent all faces, skin tones, ages, hairstyles, or reference qualities.
  • Similarity ratings can reward an attractive but incorrect reconstruction, so scene adherence and artifact scores remain separate.

Disclosures

  • The benchmark uses a Made-owned synthetic adult identity and no private user photos.
  • No provider sponsors this study.

All studies in the program are listed on the research index; the models under test are priced at wholesale on the price sheet.