The archive · Developer & Business Tools · Product decision · 2025–2026
Design Arena bets human taste, not metrics, ranks AI visuals; $7.9M seed
YC S25's 'Hot or Not' for AI design: 5M+ users vote on outputs, ~$60M ARR, $7.9M seed from Index Ventures.
Design Arena
What the business is
A crowdsourced 'Hot or Not' for AI-generated design: users vote A-vs-B on websites, images, audio and video, producing Elo rankings and human-preference data sold to AI labs.
Starting capital：$7.9M seed led by Index Ventures, with Conviction, A*, Valkyrie and YC (announced 2026-08-03).
How it started
Grace Li, Kamryn Ohly and Harvard friends founded the company weeks before graduation in 2025, initially building an AI game engine. When the games generated fine but played badly, they concluded that subjective design quality had no benchmark, and pivoted to crowdsourced A/B voting. The team joined Y Combinator's Summer 2025 batch.
What happened
At S25 Demo Day, TechCrunch listed Design Arena among the nine most sought-after startups in the batch, noting large AI labs were already customers. The consumer product is a Chat-like prompt box with drop-downs for web pages, images and a dozen other visual formats; users rank outputs from best to worst, and login-gated results let the company track how preferences shift by region.
How it ended up
Scaling: as of August 2026 it reports 5M+ users, roughly $60M annualized revenue and a $7.9M seed led by Index Ventures, with frontier labs including OpenAI and Anthropic watching its leaderboards as a design-quality signal.
Background
Design Arena is a crowdsourced benchmark for AI-generated design: users see two anonymous outputs and pick the better one, and millions of those votes feed Elo-style leaderboards. Its bet is that human taste is the missing measurement for AI visuals — no automated metric can say whether a landing page actually looks good.
Grace Li, Kamryn Ohly and Harvard friends founded it in 2025, weeks before graduation, after an AI game engine project produced games that ran but weren't fun and no one could quantify why. That puzzle became Design Arena, which joined YC S25 and quickly signed its first frontier-lab data contract roughly a week after launch.
TechCrunch's September 2025 Demo Day roundup named it one of the nine most sought-after startups in the batch. By August 2026 it reported 5.3M users, about $60M in annualized revenue, and a $7.9M seed led by Index Ventures with Conviction, A*, Valkyrie and YC participating — while OpenAI and Anthropic watched its leaderboards as a design-quality signal.
What has to be true
- Automated visual metrics miss the only thing that matters: whether output appeals to people, and organic votes capture that at a scale annotation pipelines can't match.
- The evaluation loop compounds: more voters mean better rankings mean more labs pay for the data, which funds the product that attracts more voters.
- A login-gated consumer surface produces preference data that is fresh, regional and hard to fake — a contrast to benchmark gaming.
- The wedge story (AI game engine that wasn't fun) made the founders' first customer obvious: frontier labs that can't judge their own creative output.
What can be applied
Turn evaluation into a consumer game: millions of unpaid votes become a data product labs pay for — the benchmark stays valuable only while independent.
Aftermath
As of September 2026 Design Arena is post-seed and scaling: roughly 5M+ users, about $60M annualized revenue, a 10-person team, and a live leaderboard business selling human preference data to frontier AI labs. Its category has both cautionary and encouraging precedents — the human-eval startup Yupp shut down in early 2026 after $33M from a16z crypto, while text-eval rival LM Arena raised a $150M Series A in January 2026.
Sources
- The 9 most sought-after startups from YC Demo Day
- Design Arena creators raise $8M to build the 'Hot or Not' for AI-generated visuals
- DesignArena母公司Intelligence完成790万美元种子轮融资
spotted an error? The archive wants to know.
Your turn
You just read one. Describe what you are building, and see who is betting on the same thing.
Free account · 3 free questions · no card