AI Coding Live News

Can LLMs reliably maintain spatial state representations across sequential operations? USC, UCLA, and CMU introduced Grid-Bench (arXiv:2610.22312, GitHub: grid-bench/Grid-Bench), an executable benchmark with 8,928 instances testing 2D/3D/4D grid state transitions across history lengths up to T=64. Evaluations across 6 frontier models show steep degradation: while GPT-5.6 Sol and Claude 5 Sonnet retain strong cell accuracy, open-weight and mid-tier models collapse to near-zero exact world reconstruction over long trajectories.

Zoom

Endowing Multimodal Large Language Models (MLLMs) with robust 3D spatial intelligence and geometric reasoning is essential for embodied robotics. Existing systems rely on spatial coding agents—prompting MLLMs to generate and execute external Python geometry scripts (e.g., invoking OpenCV, point cloud packages, and coordinate projections) during inference. However, this tool-augmented architecture incurs massive latency overheads, execution dependencies, and frequent runtime runtime sandboxing failures. In newly released research (arXiv:2610.11366), researchers introduce SpatialOPSD (code: github.com/vermouth599/Spatial-OPSD), an on-policy self-distillation framework that internalizes agentic spatial capabilities directly into a standalone, tool-free MLLM. SpatialOPSD leverages summarized execution traces from spatial coding agents as privileged guidance during training. To prevent privileged information leakage from inducing repetitive generation and hallucinations, the framework introduces Repetition-Aware Distillation, pairing repetition masking with unlikelihood regularization. Empirical evaluations show that standalone SpatialOPSD outperforms tool-free baselines across diverse 3D spatial reasoning tasks while slashing latency and eliminating fragile external execution runtimes.

Zoom

Humans solve complex spatial transformations by mentally simulating physical visual transitions, maintaining visual imaginations to ground multi-step reasoning. In contrast, existing Vision-Language Models (VLMs) tackle spatial questions almost entirely via text-token chains of thought, triggering acute hallucinations when predicting 3D rotations or spatial clearances. Researchers from Carnegie Mellon University and MBZUAI introduce WM-VLM (arXiv:2609.34826), integrating a lightweight world model branch directly into foundation VLMs to synthesize intermediate visual states during inference. The framework adopts a two-stage training paradigm: first training the model to foresee and render verifiable intermediate visual states, and then training it to ground downstream logical deductions upon those synthesized states. Evaluated on rigorous 2D and 3D mental rotation tasks, WM-VLM outperforms standard SFT baselines by up to 39.25 percentage points. Ablations prove that performance collapses when generated visual frames are removed or corrupted, establishing that internal world models provide indispensable spatial cognitive scaffolds.

Zoom

Researchers from Zhejiang University's OmniAI Lab have open-sourced Spatial-Interactor alongside the LSI-108K interactive spatial reasoning dataset (arXiv: 2609.23038). Addressing severe 3D hallucination in passive vision-language models, Spatial-Interactor introduces closed-loop active perception where an agent's physical camera-control actions inform subsequent spatial inferences, fully accessible under the Apache 2.0 license.

Zoom