AI Coding Live News

Continual learning without weight fine-tuning represents a frontier in LLM agent research. When an agent acts purely by writing and executing Python scripts inside an execution sandbox, every thought, hypothesis, and plan leaves a verifiable trace on disk. In a newly released study (arXiv:2610.11450), researchers subject coding agents to ARC-AGI-3—a suite of instruction-free abstract visual reasoning environments where each sequential level introduces novel causal dynamics. Developing a fine-grained measurement protocol, the authors trace thoughts across file artifacts across seven full evaluation runs spanning three foundation backbones from two major model families. The empirical findings reveal that scripts written for one level are almost never invoked in subsequent levels (only 33 of 630 cross-task references survive), as agents deliberately abandon 74% of scripts at task boundaries to purge level-specific overfitted state while rewriting core rules. Notes are maintained in an append-only fashion, with conflicting claims arbitrated against raw execution logs to achieve selective rather than catastrophic forgetting. Crucially, the study identifies carrying hard-coded variables across task boundaries as the single most devastating failure mode of autonomous agents.

Diffusion Transformers (DiTs) underpin frontier video generation systems and high-fidelity 3D modeling, yet self-attention computation over extreme sequence lengths introduces prohibitive inference latencies and memory bottlenecks. While sparse attention represents a promising acceleration pathway, existing methods suffer substantial visual quality degradation and texture corruption under high sparsity regimes. Researchers from The Chinese University of Hong Kong (CUHK) and ByteDance analyze sparse attention failures in DiTs (arXiv:2610.06801), tracing quality drops to three root causes: rigid token grouping constraints, inaccurate interaction selection, and uncompensated attention residuals from discarded tokens. The authors introduce Meta-Cached Sparse Attention (MC-Sparse, project site: dodododddo.github.io/mcsparse-project-page/), a training-free framework that preserves individual Key-Value (KV) selection precision while organizing similar Queries into tile-aligned blocks for hardware efficiency on GPUs. MC-Sparse caches query clusters, exact KV indices, and dense-sparse attention output residuals, reusing this metadata across downstream denoising timesteps. On Minimax-H3-Base video models, MC-Sparse delivers a 1.80x denoising speedup, and a 2.32x acceleration on 3D generative backbones, maintaining near-identical fidelity to dense attention with zero visible quality degradation.

Arena.ai (@arena) says Meta Muse Spark 1.3 is now in the Arena: Agent Arena measures long-horizon agentic tasks with web search, filesystem, and terminal tools via causal tracing vs the average model; it is also in Code Arena WebDev/Text/Vision/Document. Voting is open and scores are coming soon.

Weights & Biases celebrated crossing 1 billion logged runs by overhauling Weave for agent session observability and launching CoreWeave ARIA, an engine that autonomously formulates hypotheses and executes RL fine-tuning runs.