AI Coding Live News

Ai2 ships Olmo-core 3: open trillion-scale MoE training stack; 858 TFLOP/s/GPU at 1.2T on B300

On 2026-10-01 Ai2 released Olmo-core 3, an open MoE training stack (GitHub, PyPI ai2-olmo-core). It moves from FSDP to DDP + expert parallelism; on 8×B300 a 47B MoE hits ~2.7× throughput (52k vs 19.4k tok/s/GPU). Systems benches include 1.2T on 512 GPUs at up to 858 useful-model TFLOP/s/GPU and a DeepEP v2 capacity probe at 2.38T. Report: olmocore3.

Ai2 ships Olmo-core 3: open trillion-scale MoE training stack; 858 TFLOP/s/GPU at 1.2T on B300

Key Takeaways

  • Announced 2026-10-01: allenai.org/blog/olmocore3 + HF mirror + github.com/allenai/OLMo-core
  • Stack: EP/PP/distributed optimizer; NVSHMEM rowwise EP + GPU-resident routing + grouped GEMM; optional DeepEP v2
  • Throughput: expert pool 8→128 at ~3.2B active, <5% drop; 47B MoE on 8×B300 52k vs 19.4k tok/s/GPU (~2.7×)
  • Scale: 1.2T / 58.36B active / 512 GPUs up to 858 TFLOP/s/GPU (random-routing systems ref); DeepEP v2 probe 2.38T
  • MXFP8 ~+21% vs BF16, peak active mem 103→95 GiB; topology-agnostic checkpoints; next Olmo will be MoE
Read full story
Linked Models & Agents:
⚡ olmo⚡ olmoe⚡ Olmo Core 3🌐 allenai🌐 ai2🌐 Nvidia (NIM)

Ai2 open-sources AstaBrief 8B: Fast cited scientific reports; ~51s end-to-end vs Thinking ~178s

On 2026-10-02 Ai2 open-sourced AstaBrief 8B (Qwen3-8B base): one-pass cited scientific reports from a question + retrieved snippets. Powers Asta Fast mode vs Claude Thinking. End-to-end report time averages 51.1s vs 178.5s (~3.5×). Weights: allenai/AstaBrief_8B (updated 2026-10-02).

Ai2 open-sources AstaBrief 8B: Fast cited scientific reports; ~51s end-to-end vs Thinking ~178s

Key Takeaways

  • Announced 2026-10-02: HF blog + https://huggingface.co/allenai/AstaBrief_8B
  • Training: ~90K filtered real Asta queries → ~47K SFT; ~6K dual-judge-agree DPO; citation-density filtering
  • System: one-pass full report (skip Thinking’s snippet summarize/cluster + section-by-section writing)
  • Latency: Fast ~51.1s/report vs Thinking ~178.5s (~3.5×); authors did not re-run full eval vs today’s frontier
  • Use in Asta Fast mode; self-host weights; example local PDF workflow + open training data
Read full story
Linked Models & Agents:

UW & Meta FAIR Introduce Context Language Models (CLMs): Managing Context as Editable Files Boosts Agent Swarms by 65%

As autonomous software engineering agents operate across multi-hour and multi-day horizons, context management becomes a decisive bottleneck. Prevailing paradigms treat context as an external append-only log, managed through rigid heuristic pruning outside the model's awareness. Researchers from the University of Washington, Meta FAIR, and Ai2 introduce Context Language Models (CLMs), where language models natively manage their own context by treating it as an editable file subject to unrestricted in-situ read/write operations. Zero-shot CLMs decisively outperform state-of-the-art context management: scoring 5% higher with 59% fewer FLOPs on 12-hour EdgeBench, and delivering a 65% improvement at matched compute on a 24-hour multi-repository agent-swarm task. Co-designed with SGLang, a novel Suffix Cache Reuse serving mechanism reduces inference compute by 35%, charting a scalable path for autonomous long-horizon multi-agent systems.

UW & Meta FAIR Introduce Context Language Models (CLMs): Managing Context as Editable Files Boosts Agent Swarms by 65%

Key Takeaways

  • Intrinsic In-Situ Context Management: Replaces brittle external heuristic pruning with native model-controlled read, write, and patch primitives over an editable virtual context file.
  • Dramatic Efficiency Gains in Multi-Agent Swarms: Boosts performance by 65% at matched compute over 24-hour multi-repo agent swarms, while achieving 5% higher accuracy with 59% fewer FLOPs on 12-hour EdgeBench.
  • 35% Serving Speedup via Suffix Cache Reuse: Co-designed with SGLang, a novel KV cache reuse mechanism handles non-prefix edits to reduce inference computation by 35% at identical accuracy.
Read full story

Pydantic AI 2.52.0: unified Workspaces for Coder/Shell; web_fetch HTML DoS fix; CLAI2 ships

Pydantic AI shipped v2.52.0 on 2026-09-30 (pydantic-ai==2.52.0): ctx.workspace unifies local/sandbox file+command APIs with E2B, Fly.io Sprites, Modal, SSH, and Bubblewrap backends; harness moves in-repo to 0.52.0; first pydantic-clai2 release (uvx pydantic-clai2). Also patches local web_fetch nested-HTML resource exhaustion (GHSA-v36g-jcw9-x7cw, CVSS 6.5) and adds Claude Sonnet 5.5 plus GPT-6.1 Sol support.

Pydantic AI 2.52.0: unified Workspaces for Coder/Shell; web_fetch HTML DoS fix; CLAI2 ships

Key Takeaways

  • Release v2.52.0; 533 commits ahead of v2.51.0
  • Security: local web_fetch nested-HTML DoS patched (GHSA-v36g-jcw9-x7cw, CVSS 6.5); v1 patch 1.107.7; provider-native fetch unaffected
  • Workspaces via ctx.workspace (#6492) with E2B/Sprites/Modal/SSH/Bubblewrap backends; harness in-repo at 0.52.0; CLAI2 first release
  • Models: Claude Sonnet 5.5 (#8974), GPT-6.1 Sol (#9305); Anthropic default max_tokens 16384 on Sonnet 4.5+ (#9025)
  • Upgrade: pip install -U 'pydantic-ai==2.52.0'; uvx pydantic-clai2; docs: Workspace + Harness
Read full story
ADSponsored

AI21 Labs Trains Dedicated Agent Verifier Matching Frontier Quality at Fraction of Cost

AI21 Labs trained an independent agent verifier that re-evaluates claims from scratch, achieving 93.4 on the FACTS-Search benchmark and outperforming majority-vote heuristics at significantly reduced cost.

Key Takeaways

  • Independent verification isolates judges from generator reasoning to avoid shared cognitive hallucinations;
  • Targeted claim validation incurs far lower computational expense than multi-turn search re-generation;
  • Demonstrates rapid out-of-domain transfer on unseen benchmarks with minimal fine-tuning iterations.
Read full story
Linked Models & Agents:
⚡ Jamba 1.5 mini

Allen Institute and Providence Unveil AutoDiscovery AI Hypothesizing Verified Immune Signals

The Allen Institute for AI (Ai2) and Providence Swedish revealed AutoDiscovery, an AI hypothesis engine that uncovered confirmed immune activity in historically 'immune-cold' lobular breast cancer.

Key Takeaways

  • Demonstrates autonomous hypothesis generation and cross-dataset validation verified by clinical pathologists;
  • Discovers active immune signals in lobular cancer to open new potential immunotherapy treatment pathways;
  • Open research methodology and tooling released by Ai2 to accelerate scientific discovery in oncology.
Read full story
Linked Models & Agents: