AI Coding Live News

UMD & Google Introduce BeliefWeaver: Implicit World Models for Multi-Step Failure Recovery, Slashing 9B Agent Costs by 54.8%

Researchers from the University of Maryland, Google, and MBZUAI introduced BeliefWeaver (arXiv:2610.18082), an autonomous failure-recovery framework for long-horizon agents. Addressing cases where failures stem from root errors multiple steps earlier that local reflection cannot fix, BeliefWeaver maintains a persistent relational belief state across checkpoints and attempts, using an Implicit World Model (IWM) to evaluate hypotheses and gate repair execution. When distilled into a 9B model via on-policy distillation, it improves final benchmark scores by 9.8 percentage points while slashing teacher API costs by 54.8%.

UMD & Google Introduce BeliefWeaver: Implicit World Models for Multi-Step Failure Recovery, Slashing 9B Agent Costs by 54.8%

Key Takeaways

  • UMD, Google, and MBZUAI introduced BeliefWeaver (arXiv:2610.18082), an autonomous multi-step failure recovery framework for long-horizon agents
  • Maintains a persistent relational belief graph across attempts and employs an Implicit World Model (IWM) to gate repair execution
  • Improves terminal benchmark scores by +5.1 points; an on-policy distilled 9B student model beats baseline by +9.8 points
  • Slashes estimated teacher API costs by 54.8%, offering a highly economical blueprint for production-grade self-healing agents
Read full story
Linked Models & Agents:

IFM and Inception42 launch Jais 3: six open Arabic-native agentic models (0.9B–375B) plus Jais Speech, 512K context on Hugging Face

On 2026-10-15, MBZUAI’s Institute of Foundation Models (IFM) and Inception42 released Jais 3—the first language adaptation of the open K2 Horizon fleet. Six open-weight sizes run from a 0.9B dense phone model to a 375B-A23B sparse MoE (≈23B active), plus Jais Speech for Arabic ASR. Models share one training recipe and agent stack, with up to 512K context (128K on 0.9B), Apache-2.0 weights and stage checkpoints on Hugging Face, and day-0 vLLM support.

IFM and Inception42 launch Jais 3: six open Arabic-native agentic models (0.9B–375B) plus Jais Speech, 512K context on Hugging Face

Key Takeaways

  • Sizes: 0.9B / 3.7B / 7B / 32B dense + 36B-A4B (MoE+MoVA, ~4B active) + 375B-A23B (~23B active); flagship needs ~8×H200 BF16 (model card)
  • Vendor Arabic average: 375B leads open peers at 84.0 (Qwen3.5-397B 82.0); 7B scores 79.4 vs K2 Horizon base 56.4→79.6 (tech blog)
  • Agents: 3.7B/7B lead their size class by ~20 points; 375B agentic average 60.2 with SWE-Bench Verified 70.2 and Terminal-Bench 2.1 73.8 (same-harness vendor runs)
  • Speech: Jais Speech macro-average WER/CER 22.85/8.37 across six public ASR sets, ahead of Audar, Cohere Transcribe Arabic, omniASR (Jais page)
  • Ship: Apache-2.0; HF collection IFM/jais-3; vLLM≥0.30 / SGLang≥0.5.20 recipes; k2_horizon parsers; companion github.com/ifm-ai/JaisVoice
Read full story
Linked Models & Agents:

WorldGuide: MBZUAI and ANU Introduce Goal-Directed Closed-Loop Video World Model for Procedural Task Execution

Modern video foundation models synthesize photorealistic visual dynamics, yet struggle on long-horizon procedural tasks requiring sequential causal execution—such as equipment maintenance, cooking, or laboratory experiments. Current architectures rely on open-loop generation that cannot adapt to intermediate video outputs, resulting in disordered task sequences, hallucinated progress, and premature task termination. Researchers from MBZUAI and the Australian National University introduce WorldGuide (arXiv:2610.12459, repository: github.com/mbzuai-oryx/WorldGuide, site: mbzuai-oryx.github.io/WorldGuide/), formalizing procedural video generation as closed-loop task execution in visual world space. Given solely an initial image and a high-level task goal, WorldGuide iteratively predicts the next atomic action, generates the corresponding visual video clip, and inspects the synthesized state to dynamically route subsequent actions or determine task completion. A hierarchical visual memory maintains state history under bounded token footprints. To bridge supervision gaps, the authors release WorldGuide-Bench comprising approximately 59K step-annotated videos across 245 tasks and 27 procedural categories. WorldGuide achieves 33.33% Task Success on WorldGuide-Bench, outscoring the strong MiniMax-H3 model (29.90%) even when MiniMax-H3 is provided with reference plans, and surges to 47.69% on VideoCraft-Bench compared to 32.73% for MiniMax-H3 under goal-only conditioning.

Key Takeaways

  • MBZUAI and ANU introduce WorldGuide, formalizing procedural video generation as closed-loop task execution in world space
  • Achieves 33.33% Task Success on WorldGuide-Bench and 47.69% on VideoCraft-Bench, decisively outperforming MiniMax-H3
  • Open-sources WorldGuide-Bench with ~59K step-annotated videos, reducing procedural ordering errors from 62% to under 4%
Read full story
Linked Models & Agents:

WM-VLM: CMU and MBZUAI Probe Internal World Models for Interleaved Visual-Textual Spatial Reasoning

Humans solve complex spatial transformations by mentally simulating physical visual transitions, maintaining visual imaginations to ground multi-step reasoning. In contrast, existing Vision-Language Models (VLMs) tackle spatial questions almost entirely via text-token chains of thought, triggering acute hallucinations when predicting 3D rotations or spatial clearances. Researchers from Carnegie Mellon University and MBZUAI introduce WM-VLM (arXiv:2609.34826), integrating a lightweight world model branch directly into foundation VLMs to synthesize intermediate visual states during inference. The framework adopts a two-stage training paradigm: first training the model to foresee and render verifiable intermediate visual states, and then training it to ground downstream logical deductions upon those synthesized states. Evaluated on rigorous 2D and 3D mental rotation tasks, WM-VLM outperforms standard SFT baselines by up to 39.25 percentage points. Ablations prove that performance collapses when generated visual frames are removed or corrupted, establishing that internal world models provide indispensable spatial cognitive scaffolds.

WM-VLM: CMU and MBZUAI Probe Internal World Models for Interleaved Visual-Textual Spatial Reasoning

Key Takeaways

  • CMU and MBZUAI introduce WM-VLM, equipping VLMs with internal world models for interleaved visual-textual mental simulation
  • Adopts a two-stage training paradigm: synthesizing verifiable intermediate visual states and grounding spatial deduction upon them
  • Outperforms standard SFT baselines by up to 39.25 percentage points on 2D/3D mental rotations, proving causal visual grounding
Read full story
ADSponsored

KaliBench Sets Deterministic Benchmark for Cybersecurity CLI Tool Use: 8B Model Rivals 685B MoE via Verifiable Rewards

Large language models are rapidly deployed across cybersecurity workflows to translate analysts' intent into command-line interface (CLI) executions. However, existing benchmarks emphasize either high-level knowledge QA or unconstrained agent rollouts, failing to measure precise parameter binding across real-world security tooling where minor syntax glitches invalidate execution. Researchers from MBZUAI introduce KaliBench, a fine-grained natural-language-to-CLI benchmark on Kali Linux spanning 8,504 query-command pairs across 1,642 tools, 23 capability dimensions, and 5 security phases. Auditing reveals no open-weight model surpasses 42% exact accuracy without tool hints. Furthermore, reinforcement learning with KaliBench's runtime-free verifiable rewards elevates an 8B model to rival a 685B MoE frontier model.

KaliBench Sets Deterministic Benchmark for Cybersecurity CLI Tool Use: 8B Model Rivals 685B MoE via Verifiable Rewards

Key Takeaways

  • First fine-grained cybersecurity CLI benchmark spanning 1,642 Kali Linux tools and 8,504 verified query-command pairs
  • Reveals open-weight models fail to exceed 42% exact CLI accuracy in unconstrained real-world settings
  • Introduces runtime-free verifiable rewards, empowering an 8B model to match a 685B parameter MoE architecture
Read full story
Linked Models & Agents:

Omni-Embed-Mini Binds 6 Modalities Without Forgetting: MBZUAI Opens 0.9B Dense Distillation Model Outperforming Gemini

Expanding text embedding models to multimodal domains typically triggers catastrophic forgetting in text retrieval, with existing omni-modal embedders ballooning past multi-billion parameters to compensate. MBZUAI researchers introduce Omni-Embed-Mini, a compact 0.9B architecture mapping text, speech, audio, image, video, and rich documents into a single shared cosine space. Crucially, text-side weights remain bit-identical to the base model, guaranteeing zero regression on text retrieval (49.57 nDCG@10 on MTEB-v2 BEIR-8). Powered by dense cascaded caption distillation, Matryoshka SigLIP loss, and online hybrid hard-negative mining, Omni-Embed-Mini is 2.7x to 9.5x smaller than competing open models, while its 2.3B variant surpasses proprietary gemini-embedding-2 on cross-modality averages.

Omni-Embed-Mini Binds 6 Modalities Without Forgetting: MBZUAI Opens 0.9B Dense Distillation Model Outperforming Gemini

Key Takeaways

  • Unifies text, speech, audio, image, video, and rich documents into a single shared space at only 0.9B parameters
  • Guarantees zero text forgetting via bit-identical frozen text weights (49.57 nDCG@10 on MTEB-v2 BEIR-8)
  • 2.3B model variant outperforms proprietary Google gemini-embedding-2 on cross-modality retrieval averages
Read full story
Linked Models & Agents:

AA: MBZUAI open-weights K2 Horizon 375B A23B scores 47 with strong agentic results

Artificial Analysis benchmarks MBZUAI’s new open-weights MoE K2 Horizon 375B A23B (375B total / 23B active, 512K context) at 47 on the Intelligence Index—up sharply from dense K2 Think V2 (17). It leads nearby MiniMax-M3 on agentic/knowledge-work (GDPval-AA, τ³-Banking) but trails on hard reasoning (GPQA Diamond, HLE); ~26% hallucination rate is driven by abstention more than knowledge.

Key Takeaways

  • Intelligence Index 47 vs K2 Think V2 at 17; 70B dense → 375B/23B MoE with 512K context.
  • Agentic: GDPval-AA Elo 1430 vs MiniMax-M3 1380; τ³-Banking 34.2% vs 15.3%.
  • Weaker on hard knowledge/reasoning (GPQA/HLE); AA-Omniscience attempts ~40% of questions. Pricing and license TBD.
Read full story