Tencent Hunyuan (@TencentHunyuan) introduced WebCraftBench for the common failure mode where an agent claims a site is done while the homepage errors, buttons overlap, or an unrequested login flow appears. Agents operate the live app; coverage-guided exploration finds unreached paths; aesthetics, usability, and request match are scored. On 197 human-validated pairs it matches human preference 85.3%. Paper: https://arxiv.org/abs/2609.15387

Key Takeaways

  • ✓Agents are evaluated on live apps, not only static screenshots or code diffs.
  • ✓Coverage-guided exploration finds pages and flows that were never reached.
  • ✓Matches human preference 85.3% on 197 validated pairs; paper arXiv:2609.15387.
⚡

Key Decision Metrics at a Glance

TL;DR Verdict
🏆 Benchmark RankRank
Matches human preference 85.3% on 197 validated pairs; paper arXiv:2609.15387.
Full Leaderboard→
💰 Cost & PlansCompare
in: $0.14 / out: $0.55
Compare Plans↗
🛠️ Ecosystem & IDERules
WebCraftBench · Tencent · Hunyuan
Setup IDE Rules↗
🧭

Turn your technical choice into a development budget

Compare 40 dev plans & simulate token costs vs $20/mo subscriptions

⚔️ Compare Model→💰 Compare plans & limits↗
🔗

Project Links & Resources

Direct Access
Direct access to official project resources and documentation
📄
ArXiv Paper: 2609.15387
arxiv.org/abs/2609.15387
↗
Action HubReady to adopt this in production?

Benchmark side-by-side against alternatives, or calculate monthly token cost vs subscription break-even.

⚔️ Launch VS Compare→💳 View Plans↗
Up NextCline: Tencent Hy4 Preview leads SWE-bench Pro at 770B/49B active with 1M context
Read Now→