Artificial Analysis (@ArtificialAnlys) shipped Intelligence Index v4.3: Terminal-Bench upgraded 2.1→4.0 (now mini-SWE-agent harness) and τ³-Banking replaced by AutomationBench-AA (657 private Zapier business workflows). Claude Fable 5.1 and GPT-6 Astra tie at 53; OpenAI holds most of the intelligence-vs-cost frontier across Astra reasoning efforts.

Key Takeaways

  • ✓Benchmarks: Index v4.3 upgrades Terminal-Bench to 4.0 and adds AutomationBench-AA (private set).
  • ✓Weighting: private-task/answer evals rise from 40% to 45%; category weights unchanged.
  • ✓Results: Claude Fable 5.1 and GPT-6 Astra tie at 53; open-weights led by GLM-5.3 / Kimi K3 at 44.
⚡

Key Decision Metrics at a Glance

TL;DR Verdict
🏆 Benchmark RankRank
Benchmarks: Index v4.3 upgrades Terminal-Bench to 4.0 and adds AutomationBench-AA (private set).
Full Leaderboard→
💰 Cost & PlansCompare
GPT-6 Astra · in: $10 / out: $50
Compare Plans↗
🛠️ Ecosystem & IDERules
Artificial Analysis · Intelligence Index · Terminal-Bench
Setup IDE Rules↗
🧭

Turn your technical choice into a development budget

Compare 40 dev plans & simulate token costs vs $20/mo subscriptions

⚔️ Compare Model→💰 Compare plans & limits↗
Action HubReady to adopt this in production?

Benchmark side-by-side against alternatives, or calculate monthly token cost vs subscription break-even.

⚔️ Launch VS Compare→💳 View Plans↗
Up NextArtificial Analysis launches Intelligence Index v5: 60% private test sets, Claude Opus 5.5 leads at 58 and the open-weights gap widens to 12 points
Read Now→