AI Coding Live News

C
CMU Infini-AI LabInfini-AI-Lab·
👀0
🔥87

CMU Infini-AI Lab Drops CompressionBench and ServerBench: Coding Agents Compress LLMs and Design Serving Stacks; Sonnet 5.5 Hits ~4.87× vLLM Dollars-per-Dollar

Carnegie Mellon’s Infini-AI Lab posted twin arXiv benchmarks on 2026-11-04. CompressionBench asks coding agents to deliver verified compressed weights plus inference code under a storage cap (29/36 submissions pass; best-per-task designs average ~3.4% PPL above BF16). ServerBench scores complete LLM serving design by latency-qualified token value per GPU dollar; across 11 models × 3 deployments Claude Sonnet 5.5 reaches 2.97 dollars-per-dollar on Gemma E4B (~4.87× the vLLM reference) and 22/33 runs verify.

Key Takeaways

  • Official: arXiv:2611.06858 CompressionBench + arXiv:2611.06841 ServerBench (CMU Infini-AI Lab)
  • CompressionBench: 6 agents × 6 settings; 29/36 submissions pass independent verification; best designs ~3.4% PPL above BF16
  • ServerBench: objective dollars-per-dollar = latency-qualified token value / GPU cost; stateful coding-session replay
  • Paper table: Claude Sonnet 5.5 hits 2.97 on Gemma E4B (~4.87× vLLM reference); 22/33 runs verify
  • Code: github.com/Infini-AI-Lab/Compression-Bench and Server-Bench
Read full story

FrontierPhysics Launches: 56 End-to-End Physics Tasks by 42 Physicists; Claude Opus 5.5 Tops ~27.4% Pass; Failures Center on Rigorous Reasoning

On November 5, the BenchFlow team publicly launched FrontierPhysics (arXiv:2611.06910): 56 end-to-end physics-research tasks authored by 42 physicists from their own work across nine domains. Agents must do literature review, planning, research/experiments, deterministic artifacts, and a manuscript. Across 22 models in 26 configurations, no setup passed more than 46 of 168 rollouts; the best reported Pass@1 is about 27.4% for Claude Opus 5.5 in Claude Code. Expert trajectory review finds the main gaps are rigorous reasoning and expert intuition, not missing physics facts. Artificial Analysis said it will partner to host the evaluation.

FrontierPhysics Launches: 56 End-to-End Physics Tasks by 42 Physicists; Claude Opus 5.5 Tops ~27.4% Pass; Failures Center on Rigorous Reasoning

Key Takeaways

  • Scale: 56 tasks by 42 authors at 26 institutions across 9 physics domains; 56 accepted from 182 submissions; 18 based on published papers (including 4 Nature)
  • Grading: deterministic verifiers plus expert rubrics (blockers/non-blockers); a pass needs all verifiers and blockers
  • Results: 22 models / 26 configs; no configuration passed more than 46 of 168 rollouts; best Pass@1 ~27.4% for Claude Opus 5.5 in Claude Code (paper)
  • Failures: rigorous reasoning ~48%, expert intuition ~34%, literature synthesis ~27%; missing physics knowledge is not the main cause (manual audit of GPT-6 Astra)
  • Ecosystem: run via BenchFlow; Artificial Analysis will partner to host; paper arXiv:2611.06910
Read full story

Gemini API Computer Use Tool Goes GA: Browser, Mobile and Desktop Agents Production-Ready, No Breaking Changes from Preview

The Gemini API changelog shows the Computer Use tool reached general availability on October 30 across both the Interactions and GenerateContent APIs; @GoogleAIStudio announced on November 4 that there are no breaking changes from preview and it is production-ready for browser, mobile and desktop control agents. Official docs list supported models: Gemini 4 Argon, the recommended Gemini 3.8 Flash, Gemini 3.5 Flash-Lite and Gemini 3 Flash Preview. Actions carry an intent field, responses may include a safety_decision requiring user confirmation, and opt-in screenshot prompt-injection detection is available.

Key Takeaways

  • Computer Use is GA on both the Interactions and GenerateContent APIs as of October 30
  • Google says there are no breaking changes from preview, so existing code carries over
  • Three environments: browser, mobile and desktop; Gemini 3.8 Flash is the recommended model
  • Every action includes an intent field; safety_decision can require user confirmation or block
  • Opt-in screenshot prompt-injection detection (Gemini 3.5 Flash-Lite and later, off by default)
Read full story

Notion: MCP Shared Brain Lets ChatGPT, Claude, Muse and Bot Share Memories and Skills, With Official Agent Setup Prompts

On November 4 NotionHQ announced that via Notion MCP, ChatGPT, Claude, Muse and Bot can read and write the same Memories and Skills—one shared brain across agents. Official setup prompts (v0.0.6, Oct 30), help docs and a Nov 3 MCP use-cases blog corroborate the product push.

Notion: MCP Shared Brain Lets ChatGPT, Claude, Muse and Bot Share Memories and Skills, With Official Agent Setup Prompts

Key Takeaways

  • NotionHQ post (Nov 4, 19:14 UTC) had about 3,271 likes, 225 reposts, 4,560 bookmarks and ~589K views when fetched
  • Product claim: ChatGPT / Claude / Muse / Bot share Memories and Skills in Notion so switching agents does not reset context
  • Official setup prompt v0.0.6 (2026-10-30): walks agents through an Agent Operating Guide and custom-instruction paste for ChatGPT / Claude
  • Help center: Notion MCP works with Claude, Cursor, ChatGPT Pro and more; Enterprise can approve a whitelist and govern connections
  • Vendor blog (Nov 3): five team stories of MCP workflows as reusable SOPs; Skills via MCP are listed as coming soon
Read full story
ADSponsored

OpenAI Launches Images 2.6: GIFs and Saved Reference Images in ChatGPT, GPT-Image-2.6 Flare and Sunburst in the API, 50% Faster Generation

On November 4 OpenAI launched Images 2.6 across all ChatGPT and Codex tiers. Users can turn a prompt or image into a looping GIF and save reference images for reuse. The API gets two new models, GPT-Image-2.6 Flare and Sunburst, which generate images 50% faster than before; Flare can produce an image in about six seconds at low quality. The API also adds image markup edits, SVG export and a new complexity parameter.

OpenAI Launches Images 2.6: GIFs and Saved Reference Images in ChatGPT, GPT-Image-2.6 Flare and Sunburst in the API, 50% Faster Generation

Key Takeaways

  • Available today in ChatGPT and Codex on all subscription tiers across web, desktop and mobile
  • New GIF creation with adjustable speed and per-frame editing, even from a simple sketch
  • New API models: GPT-Image-2.6 Flare (as fast as about six seconds at low quality) and Sunburst (better consistency across edits at medium or high quality)
  • The API adds image markup edits, SVG export and a complexity parameter that controls how much the model plans
  • OpenAI says people create about 4 billion images per week across ChatGPT, Codex and the API
Read full story
Linked Models & Agents:
⚡ GPT-Image-2.6 Flare⚡ GPT-Image-2.6 Sunburst🤖 Codex🌐 OpenAI

RoboColosseum Opens Real-Robot Evaluation: 100+ Robots at 124 Sites, Claude Opus 5.5 and GPT-6 Astra Rival Specialized VLA Policies Zero-Shot

Hugging Face, BitRobot, the Singapore Embodied AI Centre, NUS and others launched RoboColosseum on November 4, a distributed real-robot evaluation framework covering four embodiments: SO-101, Franka, Bimanual-YAM and the Unitree G1 humanoid. The first study ran 5,699 blinded pairwise comparisons at 124 sites across 5 VLA policies and 3 frontier models. Claude Opus 5.5 and GPT-6 Astra beat their VLA counterparts on average task progress by 12.1 and 11.0 points, while Grok 4.7 trailed by 7.5. All rollouts are open on Hugging Face, and the project pledges 10,000 free evaluation hours to academic labs.

RoboColosseum Opens Real-Robot Evaluation: 100+ Robots at 124 Sites, Claude Opus 5.5 and GPT-6 Astra Rival Specialized VLA Policies Zero-Shot

Key Takeaways

  • Two tracks: the Open Track runs blinded zero-shot pairwise comparisons, and the Fine-tune Track gives each VLA the same 100 demonstrations per task across 20 tasks.
  • The VLAs tested are GR00T N1.7, pi0.5, MolmoAct2, G0.5 and LingBot-VLA v2; the frontier models are GPT-6 Astra, Claude Opus 5.5 and Grok 4.7.
  • After fine-tuning, GR00T N1.7 leads on SO-101 and pi0.5 leads on Franka and Bimanual-YAM; on the G1 humanoid no policy completes any task, with average progress of 13.3% to 23.2%.
  • Rankings agree only weakly across robots (Kendall W = 0.24), and zero-shot rankings poorly predict rankings after fine-tuning.
Read full story

Anthropic Amended S-1: $17.0B Q3 Revenue, Compute at 58% of Revenue, and About $895.4B in Committed Compute and Infrastructure Spend

Amendment No. 1 to the S-1 that Anthropic filed with the SEC on November 2 adds its first Q3 2026 numbers. Quarterly revenue was $16.956B, up 1,127% year over year and about 47% above Q2 revenue of $11.555B. Compute and infrastructure expense was $9.863B, or 58% of revenue versus 48% in Q2, including $5.0B of pricier short-term compute. Q3 swung to a $567M operating loss from $974M of operating income in Q2; a $21.9B fair-value charge on convertible notes and similar instruments drove a $23.29B net loss. Anthropic also discloses about $895.4B of purchase commitments and leases, substantially all for compute and infrastructure.

Key Takeaways

  • Q3 revenue was $16.956B, up 1,127% year over year and about 47% over Q2 revenue of $11.555B; nine-month revenue reached $33.2B
  • Compute and infrastructure expense hit $9.863B, rising to 58% of revenue from 48% in Q2, including $5.0B of short-term compute that costs far more than multi-year capacity
  • Q3 operating loss was $567M versus $974M of operating income in Q2; the $23.29B net loss is driven mainly by a $21.9B fair-value change on convertible notes and similar instruments
  • Committed compute and infrastructure spend is about $895.4B: roughly $447.5B expected before the end of 2030 and about $69.8B due in the next 12 months
  • Anthropic says it does not expect revenue to keep growing at comparable rates; headcount is about 5,300 and more than 1,900 customers pay $1M or more on a TTM basis
Read full story
Linked Models & Agents:

SenseTime Ships SenseNova 6.8 Flash: An Office Agent Model With Long-Term Memory and Proactive Interaction That Builds Animated Slides, Motion Posters and Editable Blender 3D Projects

On the evening of November 2, SenseTime released the official version of SenseNova 6.8 Flash, a multimodal agent model with two main upgrades. First, long-term memory and proactive interaction: it keeps user goals and constraints across tasks and sessions and flags affected items when information changes. Second, design generation across Web, SVG, Three.js, Blender, animated PPT and motion posters, with Figma integration. It is live in SenseNova Studio, the Raccoon assistant and the SenseNova Token Plan; the official X account says the Token Plan offers a free trial of 1,500 API requests every 5 hours. SenseTime says it beats some international frontier models on agent collaboration, data analysis and presentation generation, but the announcement lists no specific scores.

SenseTime Ships SenseNova 6.8 Flash: An Office Agent Model With Long-Term Memory and Proactive Interaction That Builds Animated Slides, Motion Posters and Editable Blender 3D Projects

Key Takeaways

  • The official release landed on the evening of November 2, positioned as a multimodal agent model for office collaboration and design delivery
  • Long-term memory plus proactive interaction: it remembers goals, constraints and preferences across sessions and suggests changes when related information shifts (demos ran on an internal Raccoon build)
  • Design output spans Web, SVG, Three.js, Blender, animated PPT and motion posters, producing editable PPTX files and Blender projects, with Figma integration
  • Available in SenseNova Studio, the Raccoon assistant and the SenseNova Token Plan; the official X post cites 1,500 free API requests every 5 hours
  • SenseTime only says it beats some international frontier models on agent collaboration, data analysis and presentation generation; no scores were published and there is no independent evaluation yet
Read full story
Linked Models & Agents:
⚡ SenseNova 6.8 Flash⚡ SenseNova Loop-9B-Preview🤖 Raccoon🌐 SenseTime

LiberAI Unveils Liber-0 World Action Model: Pretrained on 2.2M Hours of Human Experience, 36% Zero-Shot Success Across 60 Manipulation Tasks

Robotics company LiberAI announced Liber-0 on its official X account and technical blog. It is a World Action Model that jointly predicts future frames and actions, pretrained on more than 2.2 million hours of human experience and anchored by precise hand-motion data from its own LiberSense Glove. On 60 tasks proposed by GPT-6 across 600 trials, Liber-0 reached 36.0% overall success without robot demonstrations collected for those tasks, but only 10.5% on challenging multi-step tasks. No open weights or API have been announced.

LiberAI Unveils Liber-0 World Action Model: Pretrained on 2.2M Hours of Human Experience, 36% Zero-Shot Success Across 60 Manipulation Tasks

Key Takeaways

  • Zero-shot results: 63.5% on pick-and-place, 34.0% on short non-pick-and-place tasks and 10.5% on challenging multi-step tasks, 36.0% overall (60 tasks x 10 trials)
  • For comparison, GPT-6 Astra used alone as a robot policy scored 8.3%, 5.0% and 1.7% on the same three task groups, with 87.3 s of reasoning per decision
  • 10K hours of glove data beat 200 times more web human video (2,000K hours), suggesting precise action labels matter more than raw video volume
  • Glove data plus 25% of the robot demonstrations reached a progress score of 75.6, above the 72.8 from robot-only training with the full pool, using 75% fewer robot demos
  • All figures are LiberAI self-reported internal evaluations; no open weights, API or commercial timeline has been announced
Read full story
Linked Models & Agents:

Tencent Releases Hy4: First Hy Model With Vision and Computer Use, Live on Tencent Cloud and OpenRouter, Open Weights Planned

On November 4, Tencent Hy published Hy4 on its official site. Versus Augusts Hy4 preview, Tencent says it scaled up pre-training and post-training, added vision for the first time, added computer use across CLI and GUI, and trained specifically on Blender, CAD and engines like Unreal, Unity and Godot. Hy4 is live on Tencent Cloud and OpenRouter (tencent/hy4, 1M context) at the same API price as the preview. Weights and a system card are promised soon, and a cheaper Hy4 flash is coming.

Key Takeaways

  • Official blog: Introducing Hy4, dated 2026-11-04; the Tencent Hy transparency center also lists V1.0 Hy4
  • Two firsts: vision (fine-grained image detail, complex charts, math visual reasoning) and computer use (CLI plus GUI, with targeted training on Blender, CAD and long cross-app workflows)
  • Tencent's own evals: on 579 real finance tasks rated by 213 finance professionals Hy4 scores 3.04, first among open-weight models (DeepSeek-V4.1-Flash-1017 2.97, Kimi K3.1 Pro 2.68, GLM-5.3 2.68); GameDev +19.1%, GameLogic +9.8%; internal search hallucination rate 15.76% to 5.45%
  • Same API price as the preview: $0.042 cached input, $0.834 input, $2.501 output per million tokens; the OpenRouter page currently shows 50% off ($0.417/$1.251), 1,048,576 context and up to 65,536 output tokens
  • Weights are not out yet: Tencent says it will open-source them with a full system card, working with vLLM and SGLang; Hy4 flash is due soon
Read full story
Linked Models & Agents:
⚡ Hy4⚡ Hy4 preview⚡ Hy4 flash🤖 CodeBuddy🤖 WorkBuddy🌐 Tencent
ADSponsored

fal Announces $1.65B Across Series E and F for Generative Media Inference, Led by Sequoia and Bessemer with NVIDIA

fal, which hosts inference for image, video and audio models, announced on its official X account and blog on November 3 that it raised a combined $1.65B across Series E and Series F. Sequoia Capital led the Series E, closed earlier this year, and Bessemer Venture Partners led the Series F with continued investment from NVIDIA. fal did not disclose valuation or per-round amounts; Bloomberg reported the Series F at $1.3B at a $16B valuation, double the $8B from April. fal says the money funds inference capacity, hiring, and research and platform work in 2027.

fal Announces $1.65B Across Series E and F for Generative Media Inference, Led by Sequoia and Bessemer with NVIDIA

Key Takeaways

  • Confirmed by fal: $1.65B combined across Series E and F, Sequoia led E, Bessemer led F, NVIDIA continued investing (fal blog)
  • fal did not disclose valuation; Bloomberg reported the Series F at $1.3B at a $16B valuation and the Series E at $350M at $8B
  • Per Bloomberg, CEO Burkay Gur said demand spiked so much over the summer that fal had to rate limit customers, driving the large raise
  • Funds go to inference capacity, team growth and new research in 2027; fal hosts many third-party media models such as Seedance, Kling, Veo and FLUX
Read full story

Artificial Analysis Upgrades Its Six Capability Indexes to v2.0, Weighting Non-Hallucination and Agentic Tool Use; Claude Opus 5.5 Leads All Six

Independent evaluator Artificial Analysis announced on X on November 4 that its six Capability Indexes (Finance & Accounting, Strategy & Ops, Legal, Healthcare & Medical, Engineering, Economics) are now v2.0, aligned with Intelligence Index v5.0 evaluations and weighting Non-Hallucination and Agentic Tool Use more heavily. Across the indexes, HLE becomes HLE-Diamond, AA-Omniscience moves to v1.1 and GDPval-AA is removed; Engineering gains a new Science capability. Per Artificial Analysis, Claude Opus 5.5 (max) leads all six, with GPT-6 Astra (max) second in Finance & Accounting, Legal and Engineering. Among open-weights models, Kimi K3.1 Pro (weights not yet released) leads all six at #5 to #8.

Artificial Analysis Upgrades Its Six Capability Indexes to v2.0, Weighting Non-Hallucination and Agentic Tool Use; Claude Opus 5.5 Leads All Six

Key Takeaways

  • The six indexes map O*NET occupation tasks to representative benchmarks, weighted by how often each capability appears in that occupation (methodology page)
  • Common changes: HLE becomes HLE-Diamond, AA-Omniscience moves to v1.1, and GDPval-AA is dropped from Agentic Knowledge Work (now AA-Briefcase v1.1)
  • Non-Hallucination weight rises to 15% in Finance & Accounting and Legal; Agentic Tool Use (AutomationBench-AA) is 35% of Strategy & Ops, its largest component
  • Engineering adds Science (20%, CritPt v2 Hard Subset plus Terminal-Bench-Science 0.1) and FrontierCode 2.0 under Agentic Coding; Economics swaps AA-LCR for GDP.pdf
  • Results per Artificial Analysis: Claude Opus 5.5 (max) is #1 in all six; among open weights, Kimi K3.1 Pro leads all six, MiniMax-M3.1-Flash leads Strategy & Ops (#10) and DeepSeek V4.1 Flash 1017 (max) leads Healthcare & Medical (#12)
Read full story

OpenAI Shares Progress on ChatGPT and Codex for Hardware Engineering: GPT-6 Astra Designs a Codex Device in Under a Week, Mazda Joins for Aerodynamics Research

On November 3, OpenAI published "Accelerating engineering for the physical world," describing how its models help with mechanical design, electrical design and simulation. Two employees used GPT-6 Astra to design a device for talking to Codex (enclosure, PCB, firmware and software) in under a week, and a contract manufacturer built a small prototype batch in under a month, though manufacturing readiness still took several rounds of human review. Token usage across OpenAI hardware teams has grown 23-fold since February. On BenchCAD 2.0, a newer internal model averaged 0.875 versus 0.594 for GPT-6 Astra at its highest reasoning setting (OpenAI-reported). OpenAI is also expanding its work with Chip Ganassi Racing and announced a new research collaboration with Mazda.

OpenAI Shares Progress on ChatGPT and Codex for Hardware Engineering: GPT-6 Astra Designs a Codex Device in Under a Week, Mazda Joins for Aerodynamics Research

Key Takeaways

  • In a test with no direct human edits, GPT-6 Astra handled the look, enclosure structure, component selection, PCB layout, UI and firmware; two employees finished the design in under a week as a side project, and prototypes came back in under a month, per the OpenAI blog.
  • OpenAI names the gaps: Astra did not consistently account for the manufacturer's production limits, tolerances or assembly details, so manufacturing readiness took several rounds of review.
  • OpenAI hardware and infrastructure teams use Codex and ChatGPT for CAD models, 2D manufacturing drawings, simulation and FEA setup, and design reviews; token usage has grown 23-fold since February (OpenAI-reported).
  • BenchCAD 2.0 (reconstructing 3D parts and assemblies, identifying circuit-board connections): a newer internal model scored 0.875 versus 0.594 for GPT-6 Astra at its highest reasoning setting (OpenAI-reported; the internal model is unnamed and unreleased).
  • Collaborators: Chip Ganassi Racing is testing 3D-scan-to-editable-CAD and 2D drawing workflows; Mazda is working with OpenAI researchers on airflow and structural simulations for vehicle design, with results promised "in the coming months."
Read full story

Sarvam Releases Prism, an Open-Weight Decision Model Built on Sarvam 105B That Returns Calibrated Option Probabilities in About 44 ms, Apache 2.0

Indian AI company Sarvam released Sarvam Prism on November 3, a "System One" decision model for enterprise workflows: given a context and questions with fixed answer options, it returns a probability for every option in a single forward pass instead of generating text. Sarvam says that across the 25 decision models it tested, Prism averages 71.8 over three indices with a median response time of 44 ms on one B200, the highest score under 100 ms, and scores 82.5 on its Indian-language benchmark. Weights are on Hugging Face under Apache 2.0, with a hosted API as well. All scores are Sarvam's own measurements.

Sarvam Releases Prism, an Open-Weight Decision Model Built on Sarvam 105B That Returns Calibrated Option Probabilities in About 44 ms, Apache 2.0

Key Takeaways

  • Trained on the Sarvam 105B (105B-10B MoE) base; it only outputs option probabilities, so the answer is always one of the given options.
  • Vendor-reported indices: Jev Decision Index 67.0, Sarvam's recreation of the Artificial Analysis decision index 65.9, internal Indian-language benchmark 82.5, average 71.8; Perplexity Decider v1.2 averages 68.0 at about 117 ms.
  • Calibration: on English answers at 90%+ confidence it expects 3.3% errors and makes 2.2%; in Indian languages 5.4% expected vs 4.4% actual, while rivals underestimate errors by 1.5x to 4.8x.
  • By sorting options into a fixed order before scoring, it changed 0 of 2,000 answers across four shuffled option orders.
  • On 700 recorded agent runs it judges correctly 78.5% of the time overall, vs 70.7% for Claude Haiku 5.5.
  • Self-hosting needs one FP8-capable GPU with about 120 GB free memory (such as B200 or H200) and about 106 GB of disk for weights.
Read full story
Linked Models & Agents:
⚡ Sarvam Prism⚡ Sarvam 105B⚡ Perplexity Decider v1.2⚡ Jev 1.14⚡ Microsoft-Decision-1⚡ Claude Haiku 5.5🌐 Sarvam

Google Project Suncatcher Gets First AI Response From a TPU in Orbit: Gemma 4 Downlinks a Haiku, Twin Satellites Planned for 2027

Google CEO Sundar Pichai and Google Research announced that the Project Suncatcher prototype satellite, launched on October 1, finished commissioning and ran a prompt on its onboard TPU with the open Gemma 4 model, downlinking a haiku as it passed over Svalbard, Norway. Google calls it the first AI response from a data-center-class TPU in orbit. Next come thermal-stress and radiation tests, then two interconnected satellites in 2027 to test AI computation distributed across satellites.

Google Project Suncatcher Gets First AI Response From a TPU in Orbit: Gemma 4 Downlinks a Haiku, Twin Satellites Planned for 2027

Key Takeaways

  • The satellite launched on October 1 on SpaceX's Transporter-18 rideshare, built with Planet, and ran its first in-orbit inference after about three weeks of commissioning (official account).
  • Per TechCrunch, it carries four TPUs and generates up to about 1 kW, so power limits it to one TPU at a time for roughly 20 minutes.
  • Sundar Pichai's announcement drew about 26K likes and 3.97M views; Google's official account said "Our TPUs just phoned home... from space."
  • Ground proton-beam tests in Google's paper found high-bandwidth memory irregularities only after a cumulative 2 krad(Si), about 3x the 750 rad(Si) minimum requirement (as cited by The Register).
  • Two interconnected satellites are planned for 2027 to test optical inter-satellite links and AI computation distributed across satellites.
Read full story