How Contra Labs launched The Frontier Design Benchmark on X
Benchmarks AI models on design tasks instead of crowd votes
What Contra Labs launched

The AI industry has a benchmarking problem. We're letting random people on the internet decide which models are best even for capabilities like design... So we built something different. Introducing The Frontier Design Benchmark from @contralabs https://t.co/Eiw47GSxEk https://t.co/i34WKaHWrR
How LaunchVideo.com rated the launch
LaunchVideo.com rating
About the launch
Contra Labs, the research arm of commission-free freelance network Contra, launched the Frontier Design Benchmark with BenchFlow for AI labs and product teams. The benchmark ranks models on design tasks taken from paid client work, including brand assets, user flows, and business goals. Co-founder and CEO Ben Huffman wrote that current rankings let random people on the internet decide which models are best, even for design, and pointed to tests built on simple prompts such as a coffee shop landing page. The first set has 33 tasks, built after a review of 4,600 website projects on Contra. Twenty-seven are real jobs rewritten for fictional clients, and six come from startup partners who had hired a Contra designer, with those companies' brand files and site materials included. Tasks cover landing pages, web apps, and mobile apps. Designers on Contra produced a human golden design for each brief after Contra Labs reviewed a moodboard of three directions. BenchFlow ran each model in an agent harness. Scoring combines blind pairwise votes converted to Elo, a 35-item design critique rubric correlated with designer rankings at 0.94, and a detector for recurring AI design patterns. In the numbers Huffman posted with the launch, 35 designers cast 3,591 votes on 15 models. Human golden designs ranked first, winning 76% of comparisons. Claude Fable 5.2 led the named models, followed by OpenAI's GPT Astra and Kimi. The public leaderboard also lists a stealth model, Gestalt, above the human golden designs. Contra Labs has not said what Gestalt is.
Tags
Questions
Frequently asked questions
The Contra Labs launch post reached 407K views on X, with 1.9K likes, 268 reposts, 498 comments, 1.6K bookmarks.
Contra Labs launched on X on November 18, 2026 with the message "Benchmarks AI models on design tasks instead of crowd votes".
Contra Labs, the research arm of commission-free freelance network Contra, launched the Frontier Design Benchmark with BenchFlow for AI labs and product teams.
LaunchVideo.com rated the Contra Labs launch 4.20 out of 5: hook 3/5, editing / creativity 5/5, copy 5/5, sentiment of launch 5/5, distribution strategy 3/5.







