AI Coding Live News

Artificial Analysis: Tencent Hy4 Scores 35 on Intelligence Index v5, Ranked No.2 Among China Labs, 31% on FrontierCode 2.0

Independent evaluator Artificial Analysis published Tencent Hunyuan Hy4 results on the Intelligence Index v5 on November 5 (08:28 UTC): a composite score of 35, tying Grok 4.7 (xhigh) and one point behind Claude Haiku 5.5 (max). Among China-based labs it ranks second only to Kimi K3.1 Pro (46). On agentic coding it scores 31% on FrontierCode 2.0 and 37% on Terminal-Bench 4.0; cost per Intelligence Index task is about $0.78, roughly one-tenth of same-score Grok 4.7.

Artificial Analysis: Tencent Hy4 Scores 35 on Intelligence Index v5, Ranked No.2 Among China Labs, 31% on FrontierCode 2.0

Key Takeaways

  • Intelligence Index v5 composite 35: ties Grok 4.7 (xhigh), one point behind Haiku 5.5 (max, 36); No.2 China-lab model behind Kimi K3.1 Pro (46)
  • FrontierCode 2.0 at 31% (leads China labs; DeepSeek V4.1 Flash 1017 max 28%, Kimi K3.1 Pro 25%); Terminal-Bench 4.0 at 37%
  • AA-Omniscience v1.1 accuracy 50% but hallucination rate 89% (Kimi K3.1 Pro hallucination 37%); HLE-Diamond 33%
  • About $0.78 per Intelligence Index task: ~10x cheaper than same-score Grok 4.7, ~13x cheaper than Qwen3.8 Max (34), nearly 2x Haiku 5.5
  • Pricing about $0.834/$2.501 per 1M input/output tokens, cache reads $0.042; 1M context; text and image input
Read full story

RoboColosseum Opens Real-Robot Evaluation: 100+ Robots at 124 Sites, Claude Opus 5.5 and GPT-6 Astra Rival Specialized VLA Policies Zero-Shot

Hugging Face, BitRobot, the Singapore Embodied AI Centre, NUS and others launched RoboColosseum on November 4, a distributed real-robot evaluation framework covering four embodiments: SO-101, Franka, Bimanual-YAM and the Unitree G1 humanoid. The first study ran 5,699 blinded pairwise comparisons at 124 sites across 5 VLA policies and 3 frontier models. Claude Opus 5.5 and GPT-6 Astra beat their VLA counterparts on average task progress by 12.1 and 11.0 points, while Grok 4.7 trailed by 7.5. All rollouts are open on Hugging Face, and the project pledges 10,000 free evaluation hours to academic labs.

RoboColosseum Opens Real-Robot Evaluation: 100+ Robots at 124 Sites, Claude Opus 5.5 and GPT-6 Astra Rival Specialized VLA Policies Zero-Shot

Key Takeaways

  • Two tracks: the Open Track runs blinded zero-shot pairwise comparisons, and the Fine-tune Track gives each VLA the same 100 demonstrations per task across 20 tasks.
  • The VLAs tested are GR00T N1.7, pi0.5, MolmoAct2, G0.5 and LingBot-VLA v2; the frontier models are GPT-6 Astra, Claude Opus 5.5 and Grok 4.7.
  • After fine-tuning, GR00T N1.7 leads on SO-101 and pi0.5 leads on Franka and Bimanual-YAM; on the G1 humanoid no policy completes any task, with average progress of 13.3% to 23.2%.
  • Rankings agree only weakly across robots (Kendall W = 0.24), and zero-shot rankings poorly predict rankings after fine-tuning.
Read full story

Cognition launches FrontierCode 2.0 coding benchmark: it asks whether a PR should be merged, and top model Claude Opus 5.5 scores just 45.5%

Cognition, the maker of Devin, released FrontierCode 2.0 on Oct 27. It keeps the method of maintainer-written tasks graded on whether the code is actually mergeable, but draws tasks from more repositories, adds security patches and performance work, uses deliberately underspecified prompts and adds many thoroughness criteria. In Cognition's results Claude Opus 5.5 leads at 45.5%, GPT-6 Astra follows at 42.8%, and Grok 4.7 and Gemini 4 Argon drop into the 20s, leaving the benchmark far from saturated.

Cognition launches FrontierCode 2.0 coding benchmark: it asks whether a PR should be merged, and top model Claude Opus 5.5 scores just 45.5%

Key Takeaways

  • Claude Opus 5.5 leads at 45.5% (54.6% on v1.1) and GPT-6 Astra scores 42.8% (53.3% on v1.1), per Cognition (vendor-reported)
  • Grok 4.7 scores 28.6%, Gemini 4 Argon 26.3%, Muse Wonder 1.0 24.3%, SWE-2 23.9%, DeepSeek V4.1 Flash 19.3% and Kimi K3 17.7%, showing a wide gap for open models
  • Versus v1.1, reference solutions touch 67% more files and 89% more lines in codebases 25% larger; tasks come from 55% more repositories with 43% more blocking criteria
  • Thoroughness blockers grew from 168 to 501, about 3x; in 80% of tasks the reference solution improves on the upstream PR, and an audit agent found and reported an upstream security vulnerability
  • On the cost-score Pareto frontier, Opus 5.5 sits at the high end and Luna, Haiku and Sol at the low-cost end, with GPT-6.1 Sol called out for strong value (official blog)
Read full story

Letta releases FrontierMemory 1.0, a benchmark that scores agent memory by downstream task success; Opus 5.5 and GLM-5.3 tie for first at 73.3%

On October 21 Letta released FrontierMemory 1.0. Instead of quizzing agents on facts such as birthdays or hobbies, it gives an agent a set of past trajectories, has it write memory or skills, and scores that memory by how many coding and knowledge-work tasks a task agent then solves. Version 1.0 has 15 tasks adapted from public benchmarks such as DeepSWE, SkillsBench and APEX-Agents. On the model board (memory written in Letta Dream, tasks run in Letta Code) Opus 5.5 and GLM-5.3 both score 73.3% and Grok 4.7 scores 33.3%; on the harness board Letta's own Letta Dream ranks first. All numbers are Letta's own.

Letta releases FrontierMemory 1.0, a benchmark that scores agent memory by downstream task success; Opus 5.5 and GLM-5.3 tie for first at 73.3%

Key Takeaways

  • Model board (vendor-run, top effort): Opus 5.5 73.3% (about $2.80 per task), GLM-5.3 73.3% ($3.58), Kimi K3 66.7%, GPT-6.1 Sol 60.0% ($0.77, cheapest), Gemini 4 Argon 60.0%, Muse Wonder 46.7%, Grok 4.7 33.3%
  • Harness board: Letta Dream 73.3%, Prime Agent 60.0%, OpenAI Agents SDK 40.0%, Claude Managed Agents 33.3%, Hermes Agent 26.7%
  • Version 1.0 has 15 tasks; only 219 of 665 source trajectories are relevant, so the agent has to find the useful experience itself
  • Letta says 53% of the source tasks it kept had broken verifiers, which it repaired; memory generation is capped at 6 hours with no web access
  • Memory comes in three kinds (task conventions, user preferences, environment facts); outside models and harnesses can be submitted
Read full story
ADSponsored

SpaceXAI: Grok 4.7 is 50% off on Ramp Router through Oct 6; public catalog still $2/$6

On 2026-10-02 SpaceXAI said Grok 4.7 is 50% off on Ramp Router through October 6. xAI list price remains $2/$6 ($4/$12 for the whole request at ≥200k prompt tokens), and the Router catalog still shows $2.00/$6.00. Routing is free through 2026 with $26 in new-user credits. The discount is not in the docs; check request cost logs before treating $1/$3 as real.

SpaceXAI: Grok 4.7 is 50% off on Ramp Router through Oct 6; public catalog still $2/$6

Key Takeaways

  • Promo: SpaceXAI says Grok 4.7 is 50% off on Ramp Router through 2026-10-06; not restated in the docs
  • List: xAI Grok 4.7 is $2 / $6 per million tokens; ≥200k prompt tokens bill the whole request at $4 / $12
  • Catalog: docs.router.com still lists grok-4.7 at $2.00 / $6.00, 500k context, reasoning low–xhigh, no Fast tier
  • Launch scores (not a re-test): CursorBench 4.0 46.3%, Terminal-Bench 4.0 37.6%, DeepSWE v1.1 high-effort 71.0%
  • Gateway: routing free through 2026, $26 new-user credits, endpoint https://api.router.com/v1
Read full story
Linked Models & Agents:

OpenClaw 2026.9.6: managed updates, restart recovery, 30-day Usage, plus Opus 5.5 / GPT-6 Sol·Luna / Grok 4.7

OpenClaw shipped v2026.9.6 on 2026-09-23 (macOS DMG rebuilt 2026-09-24 after launch crash #156861): clearer managed-update outcomes, restart recovery for unfinished work, complete 30-day Usage reporting, a GitHub reader, remote workspace Files/Memory/Skills, live meeting notes, optional TypeSafe Jev Decision Models, and chat models Claude Opus 5.5, GPT-6 Sol/Luna, and Grok 4.7. Scale: 2,614 PRs, 178 direct commits, ~350 contributors.

OpenClaw 2026.9.6: managed updates, restart recovery, 30-day Usage, plus Opus 5.5 / GPT-6 Sol·Luna / Grok 4.7

Key Takeaways

  • Verified scale on docs: 2,614 PRs / 178 commits / ~350 contributors
  • Managed updates + restart recovery; Usage covers a full 30-day window
  • GitHub reader; remote workspaces gain Files/Memory/Skills; live meeting notes
  • Decision Models (TypeSafe Jev/local) + Opus 5.5, GPT-6 Sol/Luna, Grok 4.7
  • Install [email protected]; macOS users hit by #156861 should reinstall the rebuilt DMG (#156881)
Read full story

Elon: Grok 4.7 doing real Tesla engineering; Build harness gains self-validation and long-horizon monitoring

Elon Musk (@elonmusk) highlighted that Grok 4.7 is doing real engineering work at Tesla. The quoted post (@yunta_tsai) says Grok Build teams spent weeks tuning the 4.7 harness for cleaner prose, stronger self-validation, better thinking efficiency, long-horizon monitoring, and VLM/multimodal tasks—and that many FSD and Cybercab features were personally shipped via overnight agents.

Key Takeaways

  • Elon says Grok 4.7 is doing real engineering work at Tesla.
  • Build harness upgrades: prose quality, self-validation, thinking efficiency, long-horizon monitoring, VLM/multimodal.
  • Quoted claim: many FSD and Cybercab features shipped via overnight agents.
Read full story

Elon Musk announces Grok 4.7, urging use with the xAI Build harness

Elon Musk posted Grok 4.7, saying the model is doing real engineering work at Tesla and that results are strongest with xAI’s Build harness. It is available in Cursor, Grok Build, and via API.

Elon Musk announces Grok 4.7, urging use with the xAI Build harness

Key Takeaways

  • Elon Musk posted Grok 4.7, saying the model is doing real engineering work at Tesla and that results are strongest with xAI’s Build harness. It is available in Cursor, Grok Build, and via API.
Read full story
Linked Models & Agents:

Grok 4.7 Fast live in Grok Build and Cursor: ~2× output speed at ~2× token rates

@XFreeze reports Grok 4.7 Fast is live in Grok Build and Cursor: the same Grok 4.7 model on faster infra with roughly 2× output speed, at about 2× standard token rates. It is not in Grok Build’s free tier and is not on the public xAI API. Screenshots show Cursor’s “Grok 4.7 High Fast” picker and Grok Build’s Fast variant note.

Grok 4.7 Fast live in Grok Build and Cursor: ~2× output speed at ~2× token rates

Key Takeaways

  • Grok 4.7 Fast is available only in Grok Build and Cursor so far—not on the public xAI API.
  • Same model intelligence with ~2× output speed at ~2× standard Grok 4.7 token rates.
  • Excluded from Grok Build’s free tier; aimed at coding agents that trade higher token cost for faster inference.
Read full story

Grok 4.7 announced

Elon Musk posted “Grok 4.7.” Same-day discussion said the model improves on Grok 4.6 for agentic coding and knowledge work, and that it works best with the xAI Build harness.

Grok 4.7 announced

Key Takeaways

  • Elon Musk posted “Grok 4.7.” Same-day discussion said the model improves on Grok 4.6 for agentic coding and knowledge work, and that it works best with the xAI Build harness.
Read full story
Linked Models & Agents:
ADSponsored

Grok 4.7 launches as a faster, lower-cost frontier model

Elon Musk announced Grok 4.7. He described it as a strong mix of intelligence, speed, and low cost, said it works especially well with xAI's Build harness, and positioned it as a competitive everyday workhorse for agentic coding.

Grok 4.7 launches as a faster, lower-cost frontier model

Key Takeaways

  • Elon Musk announced Grok 4.7. He described it as a strong mix of intelligence, speed, and low cost, said it works especially well with xAI's Build harness, and positioned it as a competitive everyday workhorse for agentic coding.
Read full story
Linked Models & Agents:

Vercel: Grok 4.7 on AI Gateway with 40% off through September 27

@vercel announced Grok 4.7 is available on Vercel AI Gateway with 40% off through September 27, and can be tried with v0, eve, and fx. For developers building apps and coding agents on the Vercel stack, this lowers the cost of trying Grok 4.7.

Key Takeaways

  • Grok 4.7 is live on Vercel AI Gateway.
  • 40% off on AI Gateway through September 27.
  • Try it with v0, eve, and fx.
Read full story

Artificial Analysis: Grok 4.7 ranks just behind Anthropic on AA-Briefcase at ~50% Opus 5 cost/task

@ArtificialAnlys published AA-Briefcase results: Grok 4.7 sits behind only Anthropic models, ranking just after Opus 5 at about half the cost per task. Versus Grok 4.6 on public AA-Briefcase-Lite due-diligence decks, Analytical Quality Elo rose 1698 to 1994 while Presentation Elo slipped 1531 to 1499. Example deck API cost: Grok 4.7 (xhigh) about $8 vs Grok 4.6 (xhigh) about $4.40.

Artificial Analysis: Grok 4.7 ranks just behind Anthropic on AA-Briefcase at ~50% Opus 5 cost/task

Key Takeaways

  • AA-Briefcase: Grok 4.7 is behind only Anthropic, just after Opus 5, at ~50% cost/task.
  • Vs 4.6: Analytical Quality Elo 1698→1994; Presentation Elo 1531→1499.
  • Example decks: Grok 4.7 (xhigh) ~$8 vs Grok 4.6 (xhigh) ~$4.40.
Read full story

Elon Musk: use Grok 4.7 with the Build harness

Elon Musk posted that Grok 4.7 is out and works best with xAI’s Build harness at https://x.ai/build. Related launch posts say the model is available in Cursor, Grok Build, and the API.

Key Takeaways

  • Elon Musk posted that Grok 4.7 is out and works best with xAI’s Build harness at https://x.ai/build. Related launch posts say the model is available in Cursor, Grok Build, and the API.
Read full story
Linked Models & Agents: