UI-Bench: A Benchmark for Evaluating Design Capabilities of AI Text-to-App Tools
By: Sam Jung, Agustin Garcinuno, Spencer Mateega
Potential Business Impact:
Tests how well AI builds websites from words.
AI text-to-app tools promise high quality applications and websites in minutes, yet no public benchmark rigorously verifies those claims. We introduce UI-Bench, the first large-scale benchmark that evaluates visual excellence across competing AI text-to-app tools through expert pairwise comparison. Spanning 10 tools, 30 prompts, 300 generated sites, and 4,000+ expert judgments, UI-Bench ranks systems with a TrueSkill-derived model that yields calibrated confidence intervals. UI-Bench establishes a reproducible standard for advancing AI-driven web design. We release (i) the complete prompt set, (ii) an open-source evaluation framework, and (iii) a public leaderboard. The generated sites rated by participants will be released soon. View the UI-Bench leaderboard at https://uibench.ai/leaderboard.
Similar Papers
UI-Bench: A Benchmark for Evaluating Design Capabilities of AI Text-to-App Tools
Computation and Language
Tests AI that builds websites from words.
UI-Bench: A Benchmark for Evaluating Design Capabilities of AI Text-to-App Tools
Computation and Language
Tests AI that builds websites from words.
WebUIBench: A Comprehensive Benchmark for Evaluating Multimodal Large Language Models in WebUI-to-Code
Computation and Language
Tests AI's ability to build websites.