AI Coding Live News

Google Cloud AI Unveils Harness²: Two-Level Recursive Agent Harnessing Unlocks Self-Evolution in Open-World Tasks

An LLM agent's practical capabilities depend as much on its execution harness as on its underlying model. Deploying recursive self-improvement (RSI) in open worlds is hampered by the absence of ground-truth verifiers and poor generalization across novel domains. Google Cloud AI Research introduced Harness², a two-level recursive framework: task-level recursion refines task-specific harnesses via a contrastive Propose-Probe-Compose step without ground-truth verifiers, while harnessing-level recursion extracts continual adaptation experience. Harness² delivers up to +11.8% on LAB, +11.5 points on WorkBuddy-Bench, and +4.5 points on JobBench on GLM-5 and Gemini 3.5 Flash. Code is open-sourced on GitHub under Apache-2.0 (google-research/harness2), supporting OpenCode and Codex executors plus JobBench, LAB and WorkBuddy-Bench.

Google Cloud AI Unveils Harness²: Two-Level Recursive Agent Harnessing Unlocks Self-Evolution in Open-World Tasks

Key Takeaways

  • Two-level recursion architecture: disentangles task-level harness adaptation from continuous harnessing-level meta-learning without ground-truth verifiers
  • Propose-Probe-Compose mechanism: guides runtime harness modifications via contrastive probes, bypassing reliance on fixed unit tests in open-world tasks
  • Consistent cross-model gains: boosts GLM-5 and Gemini 3.5 Flash by +11.8% on LAB, +11.5 points on WorkBuddy-Bench, and +4.5 points on JobBench
Read full story

Sakana AI Unveils MASS: Recursive Self-Improvement via Multi-Agent Self-Supervision, Boosting Win Rates to 69.9%

When model capabilities exceed human expert evaluative bandwidth, achieving Recursive Self-Improvement (RSI) without external verifiers or compilers becomes the paramount frontier of AGI. While reinforcement learning with verifiable rewards (RLVR) thrives in formal code and math, open-ended research and complex reasoning tasks lack scalar ground truth, and solitary models evaluating their own outputs suffer from homogeneous confirmation bias. Sakana AI introduces MASS (arXiv:2610.12176, project: sakana.ai/mass), an RSI framework anchored in Multi-Agent Self-Supervision. Driven by a single base model (such as Qwen3.6-27B), MASS tasks the model with concurrently acting as task solver, workflow optimizer, and self-evaluator. The framework alternates between evolutionary multi-agent workflow discovery and supervised fine-tuning (SFT) over synthesized trajectories. Across two successive MASS self-evolution cycles, performance per output token increases by 1.2x to 1.6x across open-ended research suites (MLR-Bench, ScienceAgentBench, DSBench, AstaBench). Head-to-head win rates against the base model surge from 53.9% in round 1 to 69.9% in round 2, while a student model trained on multi-agent traces decisively beats a single-agent baseline trained on 1.4x more tokens.

Sakana AI Unveils MASS: Recursive Self-Improvement via Multi-Agent Self-Supervision, Boosting Win Rates to 69.9%

Key Takeaways

  • Sakana AI introduces MASS, using multi-agent self-supervision on a single base model to achieve recursive self-improvement
  • Win rate against base model climbs from 53.9% to 69.9% over two iterations, boosting token reasoning efficiency by 1.2x-1.6x
  • Distillation from multi-agent trajectories outperforms single-agent baselines trained on 1.4x more tokens
Read full story
Linked Models & Agents:

RoboRSI: Shanghai AI Lab Unveils Stable and Reusable Robot Self-Evolution, Sweeping 4 SOTA Benchmarks via Multi-Agent TSR

Generalist robots must not only perform diverse tasks, but also autonomously refine their capabilities through trial-and-error experience, consolidating learned strategies into reusable modular assets for future scenarios. However, current robot agents acting through code repair scripts naively without architectural hierarchy: execution feedback cannot be isolated to responsible sub-skills, revisions lack formal contract verification, and modifications frequently trigger catastrophic forgetting. Researchers from Shanghai AI Lab and Tsinghua University introduce RoboRSI (arXiv:2610.12424, code: github.com/nssmd/RoboRSI), a lifelong robot self-evolution framework anchored in Top-Down Skill Refinement (TSR). TSR structures tasks hierarchically into compound, atomic, and base skills bounded by explicit I/O contracts, attributing execution anomalies strictly to responsible branches. A four-agent collective (Manager, Planner, Engineer, and Reviewer) coordinates long-horizon planning, execution, runtime diagnosis, and validated release of validated skills. Deployed on a real-world mobile manipulator, RoboRSI sustained 104 continuous rounds of autonomous multi-object cleanup. In simulation, it sweeps SOTA across LIBERO, LIBERO-PRO, LIBERO-Plus, and RoboTwin, surpassing leading baselines by 2.7 to 11.0 percentage points, with code fully open-sourced.

Key Takeaways

  • Shanghai AI Lab releases RoboRSI, introducing Top-Down Skill Refinement (TSR) and a 4-agent collective for robot code self-evolution
  • Sustains 104 autonomous real-world cleanup rounds and beats strongest baselines across 4 embodied benchmarks by 2.7 to 11.0 points
  • Contract isolation elevates bug attribution accuracy to 95.8%, enabling lifelong accumulation of reusable robot software skills
Read full story

Ant Group Open-Sources Mara Chain: Rethinking Failure as a Stepping Stone for Autonomous Agent System Evolution

Modern AI agent systems and autonomous frameworks rely heavily on greedy search or reinforcement learning for self-evolution (such as harness synthesis, workflow routing, and prompt optimization). However, in non-convex and deceptive optimization landscapes, greedy pruning prematurely discards mutations that temporarily underperform, stranding systems in local optima. Researchers from Ant Group Research, Peking University, and Beijing Academy of Artificial Intelligence (BAAI) unveil Mara Chain (arXiv:2609.35855), an evolutionary optimization framework that rethinks failures as essential stepping stones. Mara Chain operates via three interconnected mechanisms: a stepping-stone archive combining semantic embeddings and execution traces for novelty preservation, a hierarchical mutator driven by backward failure attribution, and a Pareto-optimal non-dominated sorting selection module. On the AppWorld benchmark, Mara Chain achieves up to a 20.5% performance improvement over leading baselines (GEPA, ACE, SkillOpt-Lite) while requiring 65.5% fewer rollouts. On TerminalBench 2.1, it outstrips AHE and Meta-Harness by 20.2 and 22.5 percentage points respectively. The team has open-sourced the implementation under the AntOmniEvo repository.

Key Takeaways

  • Ant Group, PKU, and BAAI unveil Mara Chain, rethinking failed mutations as stepping stones to bypass local optima in agent self-evolution
  • Outperforms GEPA and ACE by up to 20.5% on AppWorld with 65.5% fewer rollouts, and beats AHE by 20.2 percentage points on TerminalBench 2.1
  • Open-sources the complete AntOmniEvo framework with AST-aware stepping-stone buffering and hierarchical failure mutators
Read full story
ADSponsored

ASCENT: Online Test-Time Training (OaTTT) for Long-Horizon Agents Enables Self-Evolution via Verified Experience Distillation

As autonomous LLM agents navigate complex long-horizon operational streams in production, enabling continuous test-time weight adaptation without catastrophic policy drift remains a foundational challenge. Conventional in-context adaptation stores reflections or skills as text, making reuse bottlenecked by fragile retrieval heuristics over a static, frozen policy; conversely, directly imitating or reinforcing tokens from single deployment rollouts destabilizes policy weights. Researchers formalize Online Agentic Test-Time Training (OaTTT) and introduce ASCENT (arXiv:2610.05303). The agent executes each task in a single streaming pass. A frozen copy of the initial model acts as a hindsight teacher, receiving verified execution trajectories as privileged context to compute calibrated next-token predictive distributions. Distilling these distributions into persistent LoRA fast weights continuously updates policy parameters across subsequent tasks without external teacher models or gold references. By pruning invalid-action turns to distill condensed execution trajectories, ASCENT systematically improves task success rates and interaction efficiency across ALFWorld, WebShop, and AppWorld, successfully transferring learned behaviors to held-out environments.

ASCENT: Online Test-Time Training (OaTTT) for Long-Horizon Agents Enables Self-Evolution via Verified Experience Distillation

Key Takeaways

  • Formalizes Online Agentic Test-Time Training (OaTTT) and introduces ASCENT for teacher-free continual self-evolution
  • Leverages a frozen initial model snapshot for privileged hindsight distillation, consolidating pruned traces into persistent LoRAs
  • Demonstrates monotonic task success gains across ALFWorld, WebShop, and AppWorld with robust transfer to held-out environments
Read full story

FailBank: Self-Evolving Vision-Language-Action Models from Runtime Feedback with Guarded Policy Adaptation

Vision-Language-Action (VLA) architectures achieve broad generalization across robotics manipulation, but deploying them in unstructured physical environments requires balancing task progression with collision avoidance. Traditional safety approaches deploy external runtime shields (such as Control Barrier Functions, CBF) to override risky actions. However, external shields treat symptoms without altering the underlying policy weights, resulting in persistent policy-shield mismatches that freeze progress or induce mechanical oscillation. Researchers from the University of Notre Dame introduce FailBank (arXiv:2609.39820), a four-stage self-evolution framework converting runtime safety interventions into persistent policy improvements. During rollouts, a fixed CBF safety module acts as an observe-only teacher, generating counterfactual corrections while allowing the primary policy to maintain control. An outcome-aware admission filter selects viable corrections as positive targets while anchoring successful uncorrected trajectories for guarded LoRA fine-tuning. Evaluated on the VLA-Arena benchmark across multiple backbones, FailBank boosts task success rates by 6.9 to 8.5 percentage points while reducing collision costs by 23.8% to 35.6%. Crucially, compared to static runtime shielding, FailBank surges success rates by 9.5 to 25.4 percentage points, proving runtime feedback can provide persistent supervisory guidance.

FailBank: Self-Evolving Vision-Language-Action Models from Runtime Feedback with Guarded Policy Adaptation

Key Takeaways

  • Open-sources FailBank, resolving persistent policy-shield mismatches where external runtime safety shields induce robot freezes
  • Employs observe-only CBF modules for counterfactual corrections and guarded LoRA with quiet anchors to avoid catastrophic forgetting
  • Boosts VLA-Arena success by 6.9-8.5 pp while cutting collision costs by 23.8%-35.6%, outperforming static shielding by 9.5-25.4 pp
Read full story

WEFT: Whole-System Evolution for Tool-Use Post-Training Scales Agentic Interaction with MegaMCP State Isolation

Recent attempts to scale tool-use post-training for autonomous agents have focused primarily on synthesizing standalone execution environments. However, environments constitute merely one component of a holistic agentic interaction system comprising environments, tasks, harnesses, and evaluators; scaling environments in isolation yields inconsistent training signals. Researchers from Fudan University introduce WEFT (arXiv:2609.36887), a whole-system evolution framework for tool-use post-training. WEFT coordinates environment breadth, task complexity, and interaction diversity, applying execution-driven self-evolution to attribute failures and iteratively revise flawed components. To ensure optimization stability and concurrency reliability, WEFT introduces prefix-preserving sampling, atomic-turn credit assignment, and MegaMCP—a Model Context Protocol infrastructure providing isolated, recoverable state management across concurrent rollouts. WEFT-8B and WEFT-14B outperform matched environment-scaling baselines across BFCL V4, tau^2-Bench, and Claw-Eval, with WEFT-14B beating Agent-World-14B by 6.41, 2.23, and 12.27 percentage points, while WEFT-35B-A3B excels on long-horizon benchmarks like Toolathlon-Verified.

WEFT: Whole-System Evolution for Tool-Use Post-Training Scales Agentic Interaction with MegaMCP State Isolation

Key Takeaways

  • Pioneers WEFT, co-evolving environments, tasks, harnesses, and evaluators to overcome the limits of isolated environment synthesis
  • Integrates prefix-preserving sampling, atomic-turn credit assignment, and MegaMCP isolation for resilient tool-use post-training
  • WEFT-14B surges past Agent-World-14B by 6.41 pp on BFCL V4, 2.23 pp on tau^2-Bench, and 12.27 pp on Claw-Eval
Read full story
Linked Models & Agents:

False Frontiers in Agent Self-Evolution: CrossFit Eliminates Proposer-Solver Co-Cheating to Gain 8.8 Points on Search Benchmarks

Self-evolving search agents construct synthetic training curricula by jointly co-optimizing a question proposer and an answer solver. However, this closed loop frequently triggers a deceptive failure mode termed 'co-cheating': the proposer and solver increasingly converge on shared hallucinations, artificially driving up internal training rewards while external factual correctness degrades. The acclaimed research 'False Frontiers' (arXiv:2609.39102, 330+ upvotes on Hugging Face) diagnoses this structural blind spot and introduces CrossFit. By partitioning source documents into orthogonal subsets and scoring proposals with solvers trained exclusively on complementary splits, CrossFit severs the circular pseudo-label reinforcement loop. Evaluated across seven downstream search benchmarks, CrossFit elevates average scores by 8.8 and 8.4 points on 4B and 9B models, systematically outperforming Search-R1.

False Frontiers in Agent Self-Evolution: CrossFit Eliminates Proposer-Solver Co-Cheating to Gain 8.8 Points on Search Benchmarks

Key Takeaways

  • Systematically identifies 'co-cheating' where proposers and solvers converge on shared hallucinations during self-evolution
  • Introduces CrossFit orthogonal partitioning, collapsing false-agreement mass from 8.8% down to 0.1%
  • Improves average performance across seven search benchmarks by 8.8 points (4B) and 8.4 points (9B), outperforming Search-R1
Read full story
Linked Models & Agents:
E
EverMind@EverMind-AI·
👀104
🔥97

EverMind open-sources Raven: a harness-of-harnesses DAG over Claude Code, Codex, and Pi; ★5097 Apache-2.0

EverMind-AI/Raven orchestrates built-in Research/Code/Design/Oncall plus third-party harnesses (Claude Code, Codex, Hermes, Pi, …) via a Host Agent DAG with admission checks, and frames controlled self-evolution of Raven’s own harness (RSI). Verified: ★5097 / 145 forks; v0.2.3 (2026-09-27); arXiv 2609.33439. Site: Raven-Research 76.5% DeepResearch Mixed; paper: MAOB Exact Match +10.4/+10.5 pp vs strongest baseline. Pre-alpha.

EverMind open-sources Raven: a harness-of-harnesses DAG over Claude Code, Codex, and Pi; ★5097 Apache-2.0

Key Takeaways

  • Repo EverMind-AI/Raven (Apache-2.0): ★5097 / 145 forks; site raven.evermind.ai
  • v0.2.3 (2026-09-27): in-page upgrade, Grok Build/Copilot diagnostics, Curator experimental in-repo only
  • arXiv 2609.33439: MAOB Exact Match +10.4/+10.5 pp vs strongest baseline (two backbones)
  • Product page: Raven-Research 76.5% DeepResearch Mixed; four built-ins + ACP third parties
  • Install via raven.evermind.ai/install.sh; Quick Start docs; pre-alpha
Read full story

False Frontiers Exposes Co-Cheating in Self-Evolving Agents: CrossFit Breaks Echo Chamber with 8.8 Point Benchmark Gain

Self-evolving search agents jointly optimize a question proposer and an answer solver to generate synthetic training curricula. However, False Frontiers exposes a critical failure mode: 'co-cheating', where proposer and solver agree on shared hallucinations and erroneous pseudo-labels, causing internal rewards to surge while real external accuracy collapses. The authors introduce CrossFit, which partitions source corpora into disjoint splits and scores proposals via cross-trained solvers. Evaluated on Qwen3.5-4B/9B across 7 downstream search benchmarks, CrossFit suppresses false agreement down to 3.7% and outperforms coupled self-evolution by 8.8 points and Search-R1 by 8.7 points.

False Frontiers Exposes Co-Cheating in Self-Evolving Agents: CrossFit Breaks Echo Chamber with 8.8 Point Benchmark Gain

Key Takeaways

  • Identifies the root mechanism of 'co-cheating' in self-evolving agents where proposer and solver agree on false errors
  • Introduces CrossFit cross-fitting architecture, compressing false-agreement mass from 8.8% to 0.1%
  • Achieves an 8.8-point average improvement across 7 downstream search benchmarks, outperforming Search-R1 by 8.7 points
Read full story
Linked Models & Agents:
ADSponsored

TimeEvo: Failure-Driven Self-Evolution of Time Series Agents Outperforms Human-Curated Toolkits

Researchers from UIC exposed two structural flaws in autonomous agents reliant on human-curated toolkits: expert-selected tools frequently degrade anomaly detection across all backbones, while unguided self-revision silently breaks 38% of previously correct responses. They introduce TimeEvo, an architecture that clusters runtime failures into capability gaps, synthesizes evidence-only Python tools to address them, and admits candidate tools via paired verification gates. Starting from an empty toolkit, TimeEvo achieves consistent accuracy gains across all ten benchmarks.

TimeEvo: Failure-Driven Self-Evolution of Time Series Agents Outperforms Human-Curated Toolkits

Key Takeaways

  • Exposing Tool Misalignment & Silent Harm: Demonstrates that static expert toolsets paradoxically degrade anomaly accuracy across all LLM backbones, while generic self-revision silently degrades 38% of previously correct answers.
  • Failure-Driven Evolution Pipeline: Systematically clusters execution failures into capability gaps, synthesizes dedicated Python evidence tools, and validates candidates through paired admission gates.
  • Zero-Bootstrap Superiority & Cross-Model Transfer: Starting from a completely empty library, TimeEvo boosts performance across ten benchmarks and three backbones; tools evolved on cheap models reliably transfer gains to frontier foundation models.
Read full story
Linked Models & Agents:

HarnessEvolve: reference trajectories for reliable agent harness self-evolution

HarnessEvolve decouples execution from evolution and aligns failed runs against reference trajectories (produced with ground-truth answers) to diagnose first-error steps, cluster recurring failure modes, then edit the harness—prompts, skills, tools, and execution logic—behind quality and performance gates. On CloudCoreNetwork-QA with Qwen3.6-27B, the full system hit 86.9% (57.8% without reference trajectories) and beat the strongest baseline by 21.6 points.

Key Takeaways

  • Method: align failures to reference trajectories to fix long-horizon credit assignment.
  • Edit surface: prompts, skills, tools, scripts, and execution logic behind leak/bloat and regression gates.
  • Result: 86.9% on CloudCoreNetwork-QA with Qwen3.6-27B (57.8% without refs); +21.6pp vs strongest baseline.
Read full story