AI Coding Live News

Ant Ling Launches Ling-3.2-flash: 560B/25B Native Multimodal MoE, 1M Context; Vendor Evals Beat Opus 5 on Several Vision Suites; Free for First Two Weeks

On November 5 Ant Group’s Ant Ling (@AntLingAGI) launched Ling-3.2-flash: a 560B-total / 25B-active native multimodal MoE with a 1M context window and native image, text and video input. The official changelog targets complex visual understanding, multimodal long-horizon agents, 3D understanding and interaction, and medical multimodal work; APIs are OpenAI- and Anthropic-compatible and free for the first two weeks. The launch post cites vendor evals versus Claude Opus 5 (max): OmniDocBench1.5 92.21 vs 90.56, ZEROBench(Sub) 43.71 vs 39.52, Vision2Web 85.86 vs 80.20. DesignArena placed it about #10 on Image-to-Frontend with Elo 1238.

Ant Ling Launches Ling-3.2-flash: 560B/25B Native Multimodal MoE, 1M Context; Vendor Evals Beat Opus 5 on Several Vision Suites; Free for First Two Weeks

Key Takeaways

  • Specs (official docs): 560B total / 25B active; 1M context; native image/text/video; four focuses: complex vision, multimodal long-horizon agents, 3D, medical multimodal
  • Availability: chat UI plus OpenAI/Anthropic-compatible APIs; changelog says free for first 2 weeks, then original pricing resumes
  • Vendor evals (official X): OmniDocBench1.5 92.21 vs Opus 5 90.56; ZEROBench(Sub) 43.71 vs 39.52; Vision2Web 85.86 vs 80.20
  • Third party: DesignArena Image-to-Frontend ~#10, Elo 1238; official price page stresses 2-week free promo and has not listed 3.2 USD rates yet
  • Hands-on: model id Ling-3.2-flash; use image_url / video_url blocks; weights not on Hugging Face (API-first)
Read full story
Linked Models & Agents:
⚡ Ling-3.2-flash⚡ Ling-3.1-flash⚡ Claude Opus 5🌐 Ant Ling🌐 Ant Group

BoxWorks 2026: Box and NVIDIA Unveil Box Context Retrieval, Permission-Aware Retrieval for Enterprise Agents Built on Nemotron Retriever, Plus Box Architect and Box Mount

At BoxWorks 2026 on November 5, Box announced an expanded NVIDIA collaboration: Box Context Retrieval, a new engine built on NVIDIA Nemotron Retriever embedding models, combines keyword and semantic search to return the most relevant passages to AI agents while honoring existing file permissions, with general availability for Enterprise Advanced customers planned for early next year. Box's press release claims 20% better search accuracy (Recall@5), 90% fewer tokens and 4x faster answers. Open-weight Nemotron models, starting with Nemotron 3 Ultra, are available in Box AI now. Box also unveiled Box Architect, which designs workflows from a stated goal; Box Mount, which mounts Box folders inside agent sandboxes and works with NVIDIA OpenShell; and agent security controls including MCP Guardrails.

BoxWorks 2026: Box and NVIDIA Unveil Box Context Retrieval, Permission-Aware Retrieval for Enterprise Agents Built on Nemotron Retriever, Plus Box Architect and Box Mount

Key Takeaways

  • Box Context Retrieval uses NVIDIA Nemotron Retriever with hybrid keyword and semantic search, honoring existing file permissions
  • Vendor claims: +20% Recall@5 accuracy, 90% fewer tokens, 4x faster answers; GA for Enterprise Advanced early next year
  • Open-weight Nemotron models, starting with Nemotron 3 Ultra, are available in Box AI now
  • Box Mount puts Box folders inside agent sandboxes and works with the NVIDIA OpenShell secure runtime
  • New agent security controls include MCP Guardrails, classification-based access policies and audit trails
Read full story
Linked Models & Agents:
⚡ Nemotron 3 Ultra⚡ Nemotron Retriever🌐 box🌐 Nvidia (NIM)

Gemini 3.8 TTS Adds Voice Remixing: Edit Prebuilt or Designed Voices With Natural-Language Instructions Into New Reusable Voice IDs

The official Gemini API changelog released Voice remixing on November 4. Starting from a prebuilt voice, an Extended Voice Library voice or a Voice Design persona, developers describe changes such as accent, pitch, pacing or age in natural language, and POST /v1beta/voices returns a new standalone voice_ ID usable with Gemini 3.8 Flash TTS and Flash-Lite TTS. It is also available interactively in Google AI Studio.

Key Takeaways

  • New Voice remixing feature: apply relative natural-language edits to an existing voice to create a new standalone voice
  • Uses POST /v1beta/voices (type=prompted, store=true, plus a new prompted.base_voice field) and returns a voice_ ID with a 24kHz WAV preview
  • Base voices can be any of 30 prebuilt voices, an Extended Voice Library voice, or a stored custom voice_ voice in the project
  • The resulting voice_ ID works with gemini-3.8-flash-tts and gemini-3.8-flash-lite-tts and can itself be remixed again
  • The original voice is never modified, and deleting it does not affect voices remixed from it
Read full story
Linked Models & Agents:
⚡ Gemini 3.8 Flash TTS⚡ Gemini 3.8 Flash-Lite TTS🌐 Google🌐 Google DeepMind

Google Antigravity v2.29 Brings Remote Agents and a Gemini Live Voice Mode: Agent Sessions Run in a Google-Managed Cloud and Keep Working After You Close Your Laptop, Rolling Out to AI Pro and Ultra

Ivan Leo, who works on developer experience at Google DeepMind, shared the official docs for Antigravity's new Remote Agents feature on X on November 4. Per the docs, Remote Agents run agent sessions and tools in an isolated, Google-managed remote environment, so tasks keep going when you close your laptop or browser or switch between desktop and mobile. Sessions start from the Antigravity App, the Antigravity CLI (1.4.12+, agy --remote-agent) or the web at antigravity.google.com, and remote projects can attach GitHub repositories, Google Drive files and uploads. It is rolling out gradually to Google AI Pro and Ultra subscribers on personal accounts; it is not available on the free plan, AI Plus or business accounts. The official changelog shows this ships in Antigravity v2.29.0 (November 3), which also starts rolling out a voice mode powered by Gemini Live for handing requests to the agent by voice, redesigns the Automations page into Scheduled, Always on and Paused lists, and adds a native Jupyter notebook viewer.

Key Takeaways

  • Remote Agents run in an isolated Google-managed environment with no local machine required; Remote Control instead connects to your own computer or server, and the web sidebar switches between them.
  • Three entry points: a New Remote Project in the Antigravity App, agy --remote-agent in CLI 1.4.12+, or antigravity.google.com in any browser, including mobile.
  • Remote projects can attach GitHub repositories (cloned automatically), Google Drive files and uploads (8 MiB per file, 100 MiB per project, 2 GiB per account).
  • CLI remote sessions default to the always-proceed (turbo) permission preset, so commands run without approval; locally installed MCP servers, plugins and skills are not available remotely yet.
  • Also in v2.29.0 (November 3): a Gemini Live voice mode rolling out gradually, a redesigned Automations page, and native rendering of .ipynb notebooks.
Read full story
ADSponsored

SenseTime Ships SenseNova 6.8 Flash: An Office Agent Model With Long-Term Memory and Proactive Interaction That Builds Animated Slides, Motion Posters and Editable Blender 3D Projects

On the evening of November 2, SenseTime released the official version of SenseNova 6.8 Flash, a multimodal agent model with two main upgrades. First, long-term memory and proactive interaction: it keeps user goals and constraints across tasks and sessions and flags affected items when information changes. Second, design generation across Web, SVG, Three.js, Blender, animated PPT and motion posters, with Figma integration. It is live in SenseNova Studio, the Raccoon assistant and the SenseNova Token Plan; the official X account says the Token Plan offers a free trial of 1,500 API requests every 5 hours. SenseTime says it beats some international frontier models on agent collaboration, data analysis and presentation generation, but the announcement lists no specific scores.

SenseTime Ships SenseNova 6.8 Flash: An Office Agent Model With Long-Term Memory and Proactive Interaction That Builds Animated Slides, Motion Posters and Editable Blender 3D Projects

Key Takeaways

  • The official release landed on the evening of November 2, positioned as a multimodal agent model for office collaboration and design delivery
  • Long-term memory plus proactive interaction: it remembers goals, constraints and preferences across sessions and suggests changes when related information shifts (demos ran on an internal Raccoon build)
  • Design output spans Web, SVG, Three.js, Blender, animated PPT and motion posters, producing editable PPTX files and Blender projects, with Figma integration
  • Available in SenseNova Studio, the Raccoon assistant and the SenseNova Token Plan; the official X post cites 1,500 free API requests every 5 hours
  • SenseTime only says it beats some international frontier models on agent collaboration, data analysis and presentation generation; no scores were published and there is no independent evaluation yet
Read full story
Linked Models & Agents:
⚡ SenseNova 6.8 Flash⚡ SenseNova Loop-9B-Preview🤖 Raccoon🌐 SenseTime

X Discussion: Greg Isenberg Says He Talks to His Agents More Than His Human Teammates, Shares a Full Agent-Run Company Stack

On November 3, founder and Late Checkout CEO Greg Isenberg (@gregisenberg) posted a long thread on X saying his team has 50+ people in 12 countries, yet he "talks to my agents more than my human teammates." He listed an agent-driven stack covering ideation, design, build, user testing, bug fixing and data review. Within hours it drew about 1,050 likes, 2,300 bookmarks and 183 replies. This is a personal workflow and opinion, not verified productivity data.

Key Takeaways

  • Engagement: about 1,050 likes, 2,300 bookmarks, 183 replies and 75K views within hours (per the X API); bookmarks far exceed likes, so readers are saving it as a checklist
  • Coverage: ideation, design, build, user testing, bug fixing and data review are all handed to agents; humans handle "creative feedback, relationships and telling the agents what they got wrong"
  • Build: pingdotgg/t3code as the control surface and stablyai/orca to run parallel agents, each in its own git worktree
  • Quality control: every output is scored 1-10 by an LLM judge and anything under 8 goes back; every agent mistake becomes a new skill
  • All of this is self-reported; no verifiable productivity or cost figures were published
Read full story

OpenAI Shares Progress on ChatGPT and Codex for Hardware Engineering: GPT-6 Astra Designs a Codex Device in Under a Week, Mazda Joins for Aerodynamics Research

On November 3, OpenAI published "Accelerating engineering for the physical world," describing how its models help with mechanical design, electrical design and simulation. Two employees used GPT-6 Astra to design a device for talking to Codex (enclosure, PCB, firmware and software) in under a week, and a contract manufacturer built a small prototype batch in under a month, though manufacturing readiness still took several rounds of human review. Token usage across OpenAI hardware teams has grown 23-fold since February. On BenchCAD 2.0, a newer internal model averaged 0.875 versus 0.594 for GPT-6 Astra at its highest reasoning setting (OpenAI-reported). OpenAI is also expanding its work with Chip Ganassi Racing and announced a new research collaboration with Mazda.

OpenAI Shares Progress on ChatGPT and Codex for Hardware Engineering: GPT-6 Astra Designs a Codex Device in Under a Week, Mazda Joins for Aerodynamics Research

Key Takeaways

  • In a test with no direct human edits, GPT-6 Astra handled the look, enclosure structure, component selection, PCB layout, UI and firmware; two employees finished the design in under a week as a side project, and prototypes came back in under a month, per the OpenAI blog.
  • OpenAI names the gaps: Astra did not consistently account for the manufacturer's production limits, tolerances or assembly details, so manufacturing readiness took several rounds of review.
  • OpenAI hardware and infrastructure teams use Codex and ChatGPT for CAD models, 2D manufacturing drawings, simulation and FEA setup, and design reviews; token usage has grown 23-fold since February (OpenAI-reported).
  • BenchCAD 2.0 (reconstructing 3D parts and assemblies, identifying circuit-board connections): a newer internal model scored 0.875 versus 0.594 for GPT-6 Astra at its highest reasoning setting (OpenAI-reported; the internal model is unnamed and unreleased).
  • Collaborators: Chip Ganassi Racing is testing 3D-scan-to-editable-CAD and 2D drawing workflows; Mazda is working with OpenAI researchers on airflow and structural simulations for vehicle design, with results promised "in the coming months."
Read full story

OpenAI Details Pando, Its In-House Git Backend: Median Push Latency Down Nearly 5x, Nearly 1 PB Served Daily, Built With Codex in 10 Weeks

On November 2 OpenAI published "Scaling Git at OpenAI", describing Pando, a Git-compatible backend it built for its monorepo. Per OpenAI, Pando cut median push latency by nearly 5x (about 80%), now delivers nearly a petabyte of Git data per day, and has served more than 57 TB in a single hour. It is written in Rust, its core was designed by one engineer and implemented by teams of Codex agents, and it went from kick-off to production in 10 weeks, serving production traffic since April. The trigger: Codex multiplied parallel branches and pushes, and the old system's reliability at times fell below 90%.

OpenAI Details Pando, Its In-House Git Backend: Median Push Latency Down Nearly 5x, Nearly 1 PB Served Daily, Built With Codex in 10 Weeks

Key Takeaways

  • Per OpenAI: median push latency down nearly 5x (about 80%), nearly 1 PB of Git data delivered per day, and a peak of more than 57 TB in one hour, with over 99% of bytes from local disk cache.
  • The trigger: Codex let engineers run far more branches and CI jobs in parallel; the old system struggled from late last year, with reliability at times below 90%.
  • The key trade-off: Pando drops repository-wide consistency for per-branch causal consistency and reuses pushed packfiles, stored as immutable blobs, to serve later fetches.
  • Written in Rust, core designed by one engineer and implemented by teams of Codex agents in 10 weeks; agents using GPT-6 Astra also wrote Lean and TLA+ specs to find bugs and prove properties.
  • Several improvements, such as packfile-uri fixes, are already in upstream Git, and OpenAI says it is exploring ways to share the technology with users.
Read full story

Anthropic's Amended S-1 Says Future Models May Imminently Meet Its RSP Threshold for Dramatically Accelerated AI Progress

On November 2 Anthropic filed Amendment No. 1 to its S-1 with the SEC, adding a risk disclosure: based on internal estimates and expectations about future models, not current ones, the company may imminently meet its Responsible Scaling Policy definition of dramatically accelerated progress attributable to AI. No current model has been designated as exceeding the threshold. Anthropic says it is evaluating the implications of meeting the AI R&D capability threshold, is considering RSP updates that would require human review and approval of certain R&D decisions, and does not expect to safely let Claude fully autonomously design and build successive frontier models without meaningful human supervision.

Key Takeaways

  • Filing: Anthropic, PBC's Amendment No. 1 to Form S-1, filed November 2, 2026 (SEC filing), Registration No. 333-299633.
  • Key line: based on internal estimates for future models, the company may imminently meet the RSP definition of dramatically accelerated progress attributable to AI; no current model has been designated as exceeding it.
  • Proposed measures: possible RSP updates requiring human review and approval of certain R&D decisions; Anthropic also says it recently delayed pre-training a new frontier base model by more than a month to strengthen safeguards such as preventing weight exfiltration.
  • Same filing (company figures): over 90% of contributions to Anthropic's codebase in September 2026 were written by Claude, and revenue for the three months ended September 30, 2026 was $17.0 billion.
Read full story
Linked Models & Agents:

SemiAnalysis releases GDPx, an agentic benchmark of 206 tasks across 11 high-value domains where the top model, Claude Opus 5.5, scores just 12%

On Nov 2, semiconductor and AI research firm SemiAnalysis released GDPx, a benchmark of agentic capability across 11 domains: chip design, cybersecurity, biology, finance, legal, quant trading, recursive self-improvement (RSI), hardware design, materials science, alignment and software engineering. Its 206 tasks were built by 14 specialist data partners, with SemiAnalysis doing final QA. On the official leaderboard Claude Opus 5.5 leads at 12.0%, followed by Gemini 4 Carbon at 10.9% and GPT-6 Astra at 9.6%; nearly every model scores 0 on finance and legal. SemiAnalysis says safety classifiers drag down Opus 5.5 and GPT-6 Astra, and plans a new version every 3–6 months. All scores are as reported by SemiAnalysis.

SemiAnalysis releases GDPx, an agentic benchmark of 206 tasks across 11 high-value domains where the top model, Claude Opus 5.5, scores just 12%

Key Takeaways

  • Scale: 11 domains, 14 data partners and 206 tasks, with a default time limit of 8 hours per task (GDPx site)
  • Leaderboard (as reported by SemiAnalysis): Claude Opus 5.5 12.0%, Gemini 4 Carbon 10.9%, GPT-6 Astra 9.6%, Muse Wonder Full 9.0%, Claude Fable 5.1 8.5%, GPT 6.1 Sol 8.4%, Claude Sonnet 5.5 8.2%
  • Lower tier and open weights: DeepSeek 4.1 Flash 1017 5.4%, GPT-6 Luna 5.1%, Grok 4.7 3.9%, GLM 5.3 2.7%; almost every model scores 0 on finance and legal
  • Method: each model runs in its native harness where one exists (Claude Code for Opus, Codex for Astra, Antigravity for Carbon), otherwise OpenCode; the headline is pass@1 over three attempts with all domains weighted equally (SemiAnalysis blog)
  • By domain: Opus 5.5 wins quant trading, hardware and chip design; Gemini 4 Carbon wins biology and software engineering; GPT-6 Astra wins RSI and materials science; Muse Wonder Full is the strongest cyber model
Read full story
ADSponsored

X discussion: Microsoft AI CEO Mustafa Suleyman posts "Don't build conscious superintelligence", saying AI development should stop if consciousness emerges in training

Microsoft AI CEO Mustafa Suleyman published an X article on November 1 titled "Don't build conscious superintelligence", responding to reactions to his September essay on model welfare. He clarified that his line "AIs are not conscious" was deliberately in the present tense: they are not today, and that is how they must remain. If consciousness started to emerge in training, he would call for everyone to stop AI development until those properties could be designed out. He argued that AI developers have no right to bring a new conscious species into the world and that welfare concerns should focus on humans, animals and the natural environment. He also credited Anthropic for publishing its constitution and research, while saying he disagrees with its approach. The post drew about 353 likes, 251 bookmarks and 290K views, with ethicists and practitioners on both sides. This is a personal opinion piece, not a Microsoft product or policy announcement.

X discussion: Microsoft AI CEO Mustafa Suleyman posts "Don't build conscious superintelligence", saying AI development should stop if consciousness emerges in training

Key Takeaways

  • Original post: @mustafasuleyman X article, Nov 1, 15:22 UTC, about 353 likes, 56 reposts, 79 replies, 251 bookmarks and 290K views at fetch time
  • It responds to reactions to his Sept 16 essay "It's time to talk about model welfare" (about 1,013 likes); his X bio lists CEO of Microsoft AI, author of The Coming Wave, and co-founder of DeepMind and Inflection
  • Core claim: "AIs are not conscious" describes today and that is how it must remain; any evidence of AI consciousness should be disclosed publicly at once; if consciousness emerges in training, development should stop
  • He credits Anthropic for publishing its constitution and a stream of papers and posts, says he disagrees with its approach, and calls for labs to research this together and share safety information
  • In quote posts, UMass Amherst economics and ethics scholar Itai Sher called it "very well put"; UCL professor Tim Colbourn agreed but doubted safety can be engineered by default; others noted there is no accepted theory or test of consciousness
Read full story
Linked Models & Agents:

Benji Taylor, head of design at X and SpaceXSI, open-sources Stageshow, an agent skill for realistic faux product UI and animated demos

On Oct 31, Benji Taylor, head of design at X and SpaceXSI, released Stageshow on X: an open-source skill (MIT license) for coding agents that helps them produce faux product UI that looks real, including stills, cursor demo animations, and bento grids, delivered as ordinary React components. It installs with one command, and he says it works with Grok Build, Claude Code, Codex, Gemini, and others. The launch post drew about 4,500 likes and 6,500 bookmarks. He notes it rarely nails a demo in one shot and most still take a few rounds of feedback.

Benji Taylor, head of design at X and SpaceXSI, open-sources Stageshow, an agent skill for realistic faux product UI and animated demos

Key Takeaways

  • Install: npx skills add benjitaylor/skills --skill stageshow; the author says it works with Grok Build, Claude Code, Codex, Gemini, and other agents (author's post)
  • Contents: a seven-step workflow in SKILL.md, reference rule docs, dozens of gold examples, a React kit, and self-check scripts such as film.mjs (GitHub)
  • License: the stageshow folder is MIT licensed; the repo was created Oct 26 and had about 61 stars at writing time
  • Reach: the launch post had about 4,521 likes, 6,561 bookmarks, and 213k views as of Nov 1, 08:00 SGT
  • Quality claims are the author's own: the same prompts did better with the skill, but no quantitative evaluation was published
Read full story

Anthropic adds two sentences to Claude Code's Opus 5.5 prompt to steer it away from recreating specific existing games; original and genre games still allowed

Around Oct 27, users noticed Claude Code receiving a new server-side rule (flag name tengu_heron_brook): build original games, games in a genre, and games from the user's own designs and assets, but do not build a recreation of a specific existing game, even if it is renamed or called original. The post that surfaced it drew about 8,700 likes and nearly 2 million views on Oct 30. The same day, Addy Osmani, who works on Claude Code at Anthropic, confirmed on X that the team added two sentences to Claude Code's prompt on Opus 5.5 because using Claude to infringe IP is against Anthropic's usage policy. He said original games, genre games, and games built from your own designs and assets should keep working, that the team will keep iterating, and that users can send him wrongly refused requests.

Key Takeaways

  • Scope: the change is just 2 sentences in Claude Code's system prompt for Opus 5.5, pushed from the server with no user-side toggle (Addy Osmani's post)
  • Rule text (per the flag tengu_heron_brook users captured): original games, genre games, and games from the user's own designs and assets are allowed; a recreation of a specific existing game is not, "even if it is renamed or called original" (original report, about 8,700 likes and nearly 2M views)
  • Basis: Anthropic's Usage Policy prohibits using its products to infringe, misappropriate, or violate a third party's intellectual property rights
  • Feedback path: Osmani says the team will keep tuning the line and asked users to send him wrongly refused requests; there is no separate Anthropic blog post yet, and benchmarks do not apply
Read full story

DeepSeek Harness team open-sources dsh-superagent, a proactive coding agent prototype for a single GitHub repo, alongside its Super-agent architecture article

On Oct 31, deepseek-ai open-sourced dsh-superagent-prototype on GitHub under the MIT license: a proactive coding agent that runs as a DeepSeek Harness bundle, lives on one GitHub repository and can optionally listen to Feishu. When an allowed person asks for work, it opens a work item, works in its own session and directory, and answers in the original conversation, for example with a pull request. The README states it is a research prototype, not an official DeepSeek product. The companion article, Exploring Super-agent Design, proposes a two-layer Router-Worker architecture; the team test, as reproduced by media, reports a p95 completion time of 15.7 minutes versus 29.5 minutes for a single-session setup.

Key Takeaways

  • Open source: deepseek-ai/dsh-superagent-prototype went public on Oct 31 under MIT, written in TypeScript, with about 1,800 stars at the time of writing
  • Scope: each deployment serves 1 GitHub repository, with optional Feishu; it acts only when an allowed person addresses it or a team-written rule allows it
  • Delivery: by default it only allows auto-merge for an approved pull request opened for a ticket with fewer than 200 changed lines, and never enables auto-merge as the agent account
  • Team test (as reproduced by media, vendor-reported): in a simulation with about 300 messages and 20 requests, p50 / p95 completion was 12.4 / 15.7 minutes versus 20.4 / 29.5 for a single session with a subagent tool
  • Risk: worker sessions run commands without approval as the operator's OS user, and the README asks users to review and adapt the code first
Read full story

X discussion: Anthropic's head of platform engineering says a team with no Rust developers had Claude port the whole Messages API to Rust, cutting CPU by roughly 40-50%

Katelyn Lesse, Anthropic's head of platform engineering, said on the Latent Space podcast (published Oct 27) that a Rust version of the Messages API fully rolled out the previous week. The old system was a CPU-hungry Python monolith, the team started with "not a single Rust developer", humans designed and verified the system, Claude wrote the implementation, and shadow traffic compared outputs between the old and new versions. Her ballpark figures are roughly 40-50% less CPU and 10-20% better time to first token. A clip posted by Somi (@somi_ai) drew 1,000+ likes and about 140K views on X and was quoted by swyx and others, with the debate centered on whether "never do the big rewrite" is now outdated advice. These are X discussion views and spoken estimates; Anthropic has not published a written engineering report.

X discussion: Anthropic's head of platform engineering says a team with no Rust developers had Claude port the whole Messages API to Rust, cutting CPU by roughly 40-50%

Key Takeaways

  • The first-hand source is Katelyn Lesse speaking on the Latent Space episode "How Anthropic ships Claude with Claude", in the "56:05 Rebuilding the Messages API in Rust" segment
  • Lesse said the move was driven by CPU becoming a bottleneck as usage surged; CPU now has to be capacity-planned in advance, and research sandboxes, product sandboxes and CI all draw from the same pool inside Anthropic
  • The team forked the entire API in Rust in one go, ran shadow traffic to confirm the Python and Rust outputs matched, then turned it on gradually, deliberately adding no new features during the port
  • Her ballpark is about 40-50% CPU savings and 10-20% better time to first token, with larger gains on longer-running workloads; these are spoken estimates from the podcast, not a formal benchmark
  • On X, Somi called "never do the big rewrite" dead advice and swyx said Anthropic "vibecoded their entire backend to Rust"; the latter is an exaggeration, since Lesse only discussed the Messages API
Read full story
Linked Models & Agents: