AI Coding Live News

4D/3D Vision and Fast Video Diffusion Breakthroughs: Gen4P Single-Pass 4D Perceiver, SUPRA-TEX 32.08 dB PBR Texturing, and HKUST ForcingBooster (-50.19% Patch NFE)

Three new architectures advance 4D perception, 3D PBR texturing, and real-time autoregressive video diffusion: Gen4P (arXiv:2610.22371) repurposes a video generator into a single-pass feed-forward 4D perceiver without iterative denoising; HUST and Huawei's SUPRA-TEX (arXiv:2610.22352) reaches 32.08 dB Shaded PBR PSNR on DTC-Tex; and HKUST's ForcingBooster (arXiv:2610.12625) cuts patch denoising NFE by 50.19% for a 1.30x end-to-end speedup across Wan2.1 14B and LongLive.

4D/3D Vision and Fast Video Diffusion Breakthroughs: Gen4P Single-Pass 4D Perceiver, SUPRA-TEX 32.08 dB PBR Texturing, and HKUST ForcingBooster (-50.19% Patch NFE)

Key Takeaways

  • Gen4P (arXiv:2610.22371) converts a pretrained video generator into a single-pass feed-forward 4D perceiver without iterative denoising, hitting 91.93 APD / 0.112 EPE on WorldTrack ADT
  • HUST and Huawei's SUPRA-TEX (arXiv:2610.22352) reaches 32.08 dB Shaded PBR PSNR on DTC-Tex, beating Pixal3D (29.19 dB), TRELLIS.2 (28.60 dB), and Hunyuan3D 2.1 (26.80 dB)
  • HKUST's ForcingBooster (arXiv:2610.12625) reduces patch denoising NFE by 50.19% in autoregressive video diffusion for a 1.30x end-to-end speedup (11.15s to 8.56s) with lossless VBench semantics (72.20 vs 72.21)
  • ForcingBooster generalizes across Causal Forcing, Wan2.1 14B, LingBot-World-V2, and LongLive interactive world models
Read full story
Linked Models & Agents:

Eliminating Off-Policy Bias in Asynchronous RLVR: Proximal KL Enables Token-Wise Importance Sampling, Beating GRPO on Qwen3 with Zero Training Collapse

Off-policy data in reinforcement learning with verifiable rewards (RLVR) causes severe policy gradient bias during asynchronous generation and response reuse. Researchers from UIUC and HKUST introduce Proximal KL, theoretically proving that full future KL credit renders the exact proximal optimizer the unique stationary policy without requiring full-response weights or fitted critics. Evaluated across Qwen3-1.7B and 4B models, Proximal KL outperforms GRPO on 8 math benchmarks by up to 2.58% while completely averting training collapse.

Eliminating Off-Policy Bias in Asynchronous RLVR: Proximal KL Enables Token-Wise Importance Sampling, Beating GRPO on Qwen3 with Zero Training Collapse

Key Takeaways

  • Theoretical breakthrough for off-policy gradient bias: proves full future KL credit guarantees a unique stationary policy, decoupling reference and sampling policies without sequence-level variance explosion
  • Decisive outperformance over GRPO: yields up to +2.58% micro-averaged accuracy gains across 8 mathematics benchmarks on Qwen3-1.7B and 4B, sharply improving AIME24 pass@16
  • Eliminates training collapses during off-policy refresh: permanently avoids catastrophic policy degradation seen in standard PG and CISPO, reaching peak accuracy with fewer update steps
Read full story

RSI-Anything Open-Sourced: Unlocking Domain-General Recursive Self-Improvement for AI Agents with World Models

Empowering AI agents to autonomously achieve Recursive Self-Improvement (RSI) through ongoing environmental interaction is a cornerstone of artificial general intelligence. However, practical RSI pipelines are severely constrained by two fundamental bottlenecks: scarce and expensive ground-truth feedback, and the degradation of predictive world models as evolving policies induce out-of-distribution drift. Researchers from HKUST, Shanghai AI Laboratory, Peking University, and CUHK introduce RSI-Anything (arXiv:2610.13912, code: github.com/Gen-Verse/RSI-Anything), a domain-general framework unlocking recursive self-improvement via predictive world models. Built upon the JEPA-Anything architecture, RSI-Anything establishes a disciplined six-stage paradigm: Propose → Predict → Select → Evaluate → Learn → Retain. By enforcing rigorous compatibility and safety gates governing policy-world model retention, the system continuously converts interaction logs into persistent capability upgrades. Across diverse domains, RSI-Anything drives substantial performance gains: boosting automated code repair success from a 26.3% baseline to 31.2% (+4.9 points), reducing GUI navigation action footprints by 39.4%, more than doubling laboratory planning scores from 21.80% to 46.01% over five iterations, and achieving a 96.15% chemical yield, with codebase fully open-sourced.

RSI-Anything Open-Sourced: Unlocking Domain-General Recursive Self-Improvement for AI Agents with World Models

Key Takeaways

  • RSI-Anything open-sources a domain-general recursive self-improvement framework powered by predictive world models
  • Six-stage P-P-S-E-L-R loop lifts code repair from 26.3% to 31.2% and cuts GUI navigation action footprints by 39.4%
  • Doubles laboratory planning scores across 5 rounds (21.80% to 46.01%) and achieves 96.15% chemical yield over Bayesian optimization
Read full story

FreeMatching: HKUST and ByteDance Open-Source Dense Correspondence Matching Beyond Spatio-Temporal Priors

Dense correspondence matching serves as the bedrock for optical flow, 3D stereo reconstruction, and object tracking. For decades, classical matching algorithms have fundamentally relied on rigid spatio-temporal priors: smooth motion continuity and rigid geometry. However, these foundational assumptions collapse under modern AI image editing and reference-guided generation (IEG), where visual identity is preserved while physical and geometric continuity is drastically severed (such as radical pose warps, stylistic shifts, or compositional recontextualization). Researchers from HKUST and ByteDance introduce FreeMatching (arXiv:2610.12421, code: github.com/luping-liu/FreeMatching), a generalizable framework for dense correspondence matching beyond spatio-temporal priors. FreeMatching fuses generative foundation features (from diffusion backbones) with high-level semantic representations (from vision foundation models), trained against heterogeneous supervision spanning classical benchmarks, tracked video sequences, and synthetic 3D scenes. An unsupervised teacher-guided iterative refinement loop further sharpens dense correspondences across challenging generated image pairs without requiring dense manual annotations. FreeMatching achieves dramatic leaps in correspondence precision across complex AI-edited image pairs while retaining competitive accuracy on classical optical flow tasks, and serves as an auditable quantitative metric for evaluating visual identity preservation that closely aligns with human judgment.

Key Takeaways

  • HKUST and ByteDance open-source FreeMatching, breaking free from traditional spatio-temporal priors in dense correspondence
  • Cuts end-point error by 42.6% and raises PCK by 31.8 percentage points across aggressive AI image edits and non-rigid transformations
  • Establishes a quantitative identity preservation metric highly correlated with human judgment (r = 0.88), fully available on GitHub
Read full story
Linked Models & Agents:
ADSponsored

HKUST Uncovers the Mechanistic Reality of Reasoning Distillation: On-Policy Distillation Teaches Compositional Skills, Not Factual Knowledge

The emergence of reasoning models such as OpenAI o1/o3 and DeepSeek-R1 sparked widespread efforts to distill dense reasoning traces into smaller 7B and 14B student models, unlocking striking performance leaps on math and coding benchmarks. However, a fundamental mechanistic question has lingered: does On-Policy Distillation (OPD) inject new parametric factual knowledge into the student, or does it merely impart compositional reasoning skills? Researchers from Hong Kong University of Science and Technology (HKUST) address this mystery in a landmark study (arXiv:2610.09639). Utilizing a controlled synthetic framework across four models from three distinct architectures, the authors independently isolate factual memory from multi-step compositional ability. The experiments establish that reverse-KL OPD reliably transfers compositional problem-solving skills across unseen task structures, but transfers minimal factual knowledge. Replacing reverse-KL with forward-KL restores factual memorization, while student rollouts specifically refine multi-step logical execution. These findings demonstrate that on-policy distillation does not expand a model's knowledge boundary, but rather teaches it to mobilize and organize facts it already possesses.

Key Takeaways

  • HKUST demonstrates through controlled synthetic frameworks that on-policy distillation (OPD) transfers compositional skills but minimal factual knowledge
  • Proves reverse-KL optimizes multi-step logical execution while forward-KL is required for parametric factual memorization
  • Establishes a principled two-stage recipe for reasoning agents: forward-KL for factual ingestion, followed by reverse-KL for reasoning activation
Read full story

REMORY: HKUST and Alibaba Introduce Residual Memory for Agent Context Compaction, Matching Full Context with Only 5.2% Token Overhead

As autonomous agents execute complex multi-step workflows across terminal consoles and web browsers, context window expansion and escalating token costs impose severe operational bottlenecks. Conventional compaction methods rely on text summarization or token pruning, both of which discard crucial state variables and induce semantic drift over extended sessions. Researchers from HKUST and Alibaba present REMORY (arXiv:2610.11287), introducing a residual memory paradigm designed for sequence-level context compaction. REMORY combines lossy natural language summaries with bounded sets of learned soft memory tokens, effectively forming a residual connection in the sequence dimension. While text summaries convey high-level narrative continuity, the soft memory tokens reconstruct lost fine-grained execution artifacts, API arguments, and intermediate environment states. On challenging benchmarks including BrowseComp and Terminal-Bench 2.1, REMORY retains 97% of full-context task performance while occupying only 5.2% of the original input token footprint, slashing redundant tool retries and loops by more than 40%.

Key Takeaways

  • HKUST and Alibaba propose REMORY, establishing sequence-dimension residual memory connections to resolve agent context bloat
  • Matches 97.2% of full-context capability using only 5.2% of token positions, slashing repetitive tool errors by 41.5% on Terminal-Bench
  • Non-invasive plug-and-play architecture reduces TTFT latency by 73.8%, setting a new benchmark for long-horizon agent efficiency
Read full story
Linked Models & Agents:

FrugalEvo: Cost-Aware LLM-Guided Program Evolution Slashes Multi-Agent Optimization Costs by 97% with Prefix-Cache Reuse

LLM-guided evolutionary algorithms (such as AlphaEvolve) have achieved breakthrough results in computational optimization, including circle packing and systems tuning. However, existing methods optimize strictly over iteration counts rather than fiscal expenditure, burning dozens of dollars per task. Researchers from NUS, Stanford, and HKUST present FrugalEvo (arXiv:2610.03675), a cost-aware program evolution framework maximizing gain per dollar. FrugalEvo implements an asymmetric dual-LLM division of labor: a powerful, higher-cost LLM explores high-level solution concepts, while a cheap, high-speed LLM generates and iteratively refines concrete implementations. Additionally, FrugalEvo engineers prompt harnesses to maximize prefix KV-cache reuse across evolutionary generations. Across 10 mathematical optimization problems and ALE-Bench-Lite suites, FrugalEvo matches or outperforms OpenEvolve, EvoX, and SwarmResearch. On circle packing, FrugalEvo achieves SOTA performance using GLM-5.3/Flash for only $0.55 and GPT-5.6 Terra/Luna for $1.68—slashing costs by up to 99% compared to conventional $50 multi-agent baselines.

FrugalEvo: Cost-Aware LLM-Guided Program Evolution Slashes Multi-Agent Optimization Costs by 97% with Prefix-Cache Reuse

Key Takeaways

  • Pioneers FrugalEvo, the first cost-aware LLM program evolution framework maximizing optimization gain per dollar spent
  • Pairs an asymmetric dual-LLM hierarchy with prefix KV-cache reuse, establishing the new Budget-Aware AUC (BA-AUC) benchmark
  • Achieves SOTA on circle packing for $0.55-$1.68, outperforming $50 multi-agent baselines like CORAL and SwarmResearch
Read full story

CorrGRPO Solves Multi-Reward Imbalance in GRPO: Pearson Correlation Normalization Boosts Code & Tool Calling

Group Relative Policy Optimization (GRPO) forms the reinforcement learning foundation for reasoning models like DeepSeek-R1 by normalizing group rewards to derive advantage estimates. However, practical LLM alignment requires balancing multiple competing rewards, such as code execution correctness, format compliance, tool-calling precision, and safety. Standard GRPO computes advantage normalization across aggregate variance, causing large-scale, highly correlated reward components to overshadow critical fine-grained signals. HKUST researchers propose CorrGRPO (Correlation-Normalized GRPO), which normalizes reward covariances into Pearson correlation coefficients. Across code generation, tool invocation, and agent safety benchmarks spanning 0.5B to 8B models, CorrGRPO systematically outperforms standard GRPO.

CorrGRPO Solves Multi-Reward Imbalance in GRPO: Pearson Correlation Normalization Boosts Code & Tool Calling

Key Takeaways

  • Addresses multi-reward scale imbalances in DeepSeek-R1 style GRPO using Pearson correlation coefficient normalization
  • Lifts HumanEval/MBPP code generation Pass@1 by 3.2 to 4.8 percentage points over standard GRPO baselines
  • Balances performance and guardrails, lifting tool-calling completion by 5.4% and safety defense from 82.1% to 93.7%
Read full story