AI Coding Live News

Baidu Opens ERNIE-5.5-Flash-Base: 280B-A14B MoE, 33.5T Pretrain, Vendor-Reported MMLU 93.3

On November 5 Baidu (official blog + @BaiduResearch) open-sourced ERNIE-5.5-Flash-Base: a text-only MoE base checkpoint at end of pre-training (no mid/post-training), 280B total / 14B active per token, 33.5T pretrain tokens, up to 128K train context and 1M for fine-tune/inference. FP8 and BF16 weights are on Hugging Face and ModelScope. Under Baidu's unified eval pipeline vs similar bases: MMLU 93.3, HumanEval+ 82.3, LiveCodeBench 40.1 (vendor-reported). Post-trained ERNIE 5.5 Flash "will follow". License is custom (excludes EU/UK/South Korea; commercial use above $50M related revenue needs prior written authorization).

Baidu Opens ERNIE-5.5-Flash-Base: 280B-A14B MoE, 33.5T Pretrain, Vendor-Reported MMLU 93.3

Key Takeaways

  • Nov 5 open base at end of pre-training: 280B total / 14B active — not a chat/instruct model
  • 33.5T pretrain tokens; up to 128K train context, 1M for fine-tune and inference
  • Vendor unified eval: MMLU 93.3, HumanEval+ 82.3, LiveCodeBench 40.1 vs similar bases
  • Architecture: 37 HCA + 6 MLA-DSA layers; Multi-Router Latent MoE (512 routed top-10 + 1 shared)
  • Custom license (not Apache): excludes EU/UK/South Korea; >$50M related revenue needs Baidu written authorization
Read full story
Linked Models & Agents:
⚡ Ernie 5.5 Flash Base🌐 Baidu (百度文心)

Together AI Launches Together Compiler: Agents Continually Optimize Production Inference, Up to 2.6x Higher TPS

On November 4 Together AI launched Together Compiler (TKCC), which pairs a swarm of AI agents with a persistent inference engine to keep rewriting inference kernels for real traffic, models and hardware, as part of what it calls Polymorphic Inference. The company says that within 24 hours it reached up to 2.6x higher TPS on models such as Kimi K3, GLM 5.3, MiniMax M3.1-Flash and DeepSeek v4.1-Flash, up to 50% faster on customer workloads, and it already serves trillions of tokens a day in production.

Key Takeaways

  • Together Compiler recasts inference optimization from a classic compiler problem into an agentic search: agents propose kernel changes, a persistent engine checks speed and correctness, and only verified changes reach production
  • Together says that within 24 hours it reached up to 2.6x higher TPS on Kimi K3, GLM 5.3, MiniMax M3.1-Flash and DeepSeek v4.1-Flash, and up to 50% faster on customer workloads
  • On InferenceX low-latency batch size 1 it reports 1,111 TPS on MiniMax M3.1-Flash and 1,205 TPS on DeepSeek v4.1-Flash (company-reported); SemiAnalysis said it validated one of the results
  • The persistent engine hot-reloads candidate forward passes, cutting time to serving to 9 seconds versus 467 seconds for restarting an engine, with 252x higher experiment throughput than baseline agentic optimization systems
  • It already serves trillions of tokens a day in Together's production stack, where 40+ models are now optimized by agents
Read full story

Fireworks Forge Launches: Ultra-fast Inference Preview Hits 1,500 Tokens/s, Half-Price Background Mode, Nexus Desktop for Codex and Claude Desktop, Sovereign Private Preview

At its first Forge conference on November 3, open-model inference platform Fireworks launched a batch of products. Ultra-fast, powered by NVIDIA Blackwell, is in public preview at up to 1,500 tokens per second on DeepSeek V4.1 Flash, cutting a 30-turn agent task from 1 minute to 8 seconds. Background Mode runs deferrable work at half price, alongside multi-day prompt caching and higher rate limits. Nexus Desktop brings open-model routing into the Codex app, Claude Desktop and OpenCode, with Pro plans from $8 per month. Fireworks also announced No Eval, serverless LoRA inference, the Fireworks Sovereign private preview and a 60+ partner Frontier Ecosystem.

Fireworks Forge Launches: Ultra-fast Inference Preview Hits 1,500 Tokens/s, Half-Price Background Mode, Nexus Desktop for Codex and Claude Desktop, Sovereign Private Preview

Key Takeaways

  • Ultra-fast public preview: on NVIDIA Blackwell, up to 1,500 tokens per second on DeepSeek V4.1 Flash; in Fireworks' benchmark a 30-turn agent task fell from 1 minute to 8 seconds (Fireworks blog)
  • Cost options: Background Mode runs deferrable work at half price; multi-day prompt caching cuts the cost of resuming long context; higher serverless rate limits and Elastic Burst are generally available
  • Nexus Desktop launches: personalized routing across open and closed models inside the Codex app, Claude Desktop and OpenCode; Pro from $8 per month, Teams from $10 per seat per month
  • Training: No Eval (private preview) turns production traces into task evals; serverless LoRA inference (public preview) starts with GLM 5.3 Flash at per-token pricing with no idle charge; free training on Muse Glimmer 30B through November 30
  • Enterprise: Fireworks Sovereign (private preview) runs the inference engine in a customer's own cloud or data center; Fireworks says it already manages over 25,000 GPUs in customer environments; plus a 60+ partner Frontier Ecosystem
Read full story

fal Announces $1.65B Across Series E and F for Generative Media Inference, Led by Sequoia and Bessemer with NVIDIA

fal, which hosts inference for image, video and audio models, announced on its official X account and blog on November 3 that it raised a combined $1.65B across Series E and Series F. Sequoia Capital led the Series E, closed earlier this year, and Bessemer Venture Partners led the Series F with continued investment from NVIDIA. fal did not disclose valuation or per-round amounts; Bloomberg reported the Series F at $1.3B at a $16B valuation, double the $8B from April. fal says the money funds inference capacity, hiring, and research and platform work in 2027.

fal Announces $1.65B Across Series E and F for Generative Media Inference, Led by Sequoia and Bessemer with NVIDIA

Key Takeaways

  • Confirmed by fal: $1.65B combined across Series E and F, Sequoia led E, Bessemer led F, NVIDIA continued investing (fal blog)
  • fal did not disclose valuation; Bloomberg reported the Series F at $1.3B at a $16B valuation and the Series E at $350M at $8B
  • Per Bloomberg, CEO Burkay Gur said demand spiked so much over the summer that fal had to rate limit customers, driving the large raise
  • Funds go to inference capacity, team growth and new research in 2027; fal hosts many third-party media models such as Seedance, Kling, Veo and FLUX
Read full story
ADSponsored

Flower Labs Releases Endeavor 1.1: Multimodal, EU-Only Inference and Private Deployment With Readable Thinking Traces, Claims Parity With OpenAI and Anthropic

Flower Labs, the company behind the Flower federated learning framework, released Endeavor 1.1 on November 3, its third model this year after the UK sovereign 7B model Lizzy in April and Endeavor 1.0 in September. The update adds image input, an optional EU-only GPU inference tier, and Flower-managed, private-cloud or on-premises deployment, and promises readable thinking traces plus ownership of outputs that customers may use to train their own models. Vendor-reported scores are GPQA 94.4, HumanEval 99.9, AIME 2026 99.9 and MMMU-Pro 81.1, but the comparison uses GPT-5.6 Sol and Claude Fable 5 rather than either lab's newest models, and access is request-only for now.

Flower Labs Releases Endeavor 1.1: Multimodal, EU-Only Inference and Private Deployment With Readable Thinking Traces, Claims Parity With OpenAI and Anthropic

Key Takeaways

  • Vendor-reported: GPQA rose from 92.0 in 1.0 to 94.4 (about 30% fewer errors), HumanEval from 98.2 to 99.9; IFEval is 94.5 and MMMU-Pro 81.1.
  • In the vendor table, GPT-5.6 Sol scores GPQA 94.1, IFEval 95.9 and MMMU-Pro 83.0, and Claude Fable 5 scores GPQA 92.6; Endeavor does not lead on IFEval or MMMU-Pro.
  • New EU-only GPU inference with SLAs, with UK, Middle East, Asia and Africa regions planned.
  • The pitch is control: raw thinking traces, ownership of outputs and traces, and the right to fine-tune or train your own models on them.
  • Flower says the model builds on mature open-weight models via continual pre-training, targeted post-training and model integration, without naming the base or parameter count; access is request-only.
Read full story
Linked Models & Agents:
⚡ Endeavor 1.1⚡ Endeavor 1.0⚡ GPT-5.6 Sol⚡ Claude Fable 5⚡ Kimi K3⚡ Nemotron 3 Ultra🌐 Flower Labs

Anthropic Open-Sources FlashProve: zkSNARK Proofs That a Reply Came From the Committed Model, About 110 Tokens/s for 400B Llama 4 Maverick on One H100

Anthropic's Frontier Red Team published a research post on November 2 and open-sourced FlashProve under Apache 2.0. A model provider commits to hidden weights once, then attaches a zero-knowledge proof to each reply, so a user without the weights can check on an ordinary CPU that the reply really came from that model. That targets routing services that quietly swap in cheaper models and tampered token streams. Anthropic reports about 110 tokens/s on one H100 for Llama 4 Maverick (400B MoE, 4-bit), proofs of about 19 MB per 1,024-token request, and roughly 70-95x the GPU time of vLLM inference. It is an unmaintained research prototype limited to 1,024-token contexts and greedy decoding of an integer version of the model. Anthropic engineer Steve Weis shared the release on X.

Anthropic Open-Sources FlashProve: zkSNARK Proofs That a Reply Came From the Committed Model, About 110 Tokens/s for 400B Llama 4 Maverick on One H100

Key Takeaways

  • Anthropic-reported: on Llama 4 Maverick (400B MoE, 4-bit) one H100 proves about 110 tokens/s (prefill, 24 requests per batch), with proofs of about 19 MB per 1,024-token request.
  • It is costly: roughly 70-95x the GPU time of vLLM inference; the performance page lists about 270 GB of host memory for serving and about 39 minutes to commit to a set of weights.
  • Verification needs no GPU: the C++ verifier checks a proof in about 21 seconds on one thread, and a slower Lean verifier plus Lean 4 proofs of the security theorem are included.
  • Against prior work: VerInf proved the same model at about 0.02 tokens/s; the commercial Attestable reached 53-77 tokens/s on Gemma 4 31B but has no open-source release.
  • Limits: v0.16.0 is an unmaintained research prototype with 1,024-token contexts, greedy decoding of an integer model only, and no architecture hiding.
Read full story
Linked Models & Agents:

OpenAI Signs Four Abu Dhabi Agreements: ADNOC Becomes First Energy Company to Deploy Its Frontier Tech, Machine-Readable Government Pilot Already Live

On November 2, Abu Dhabi Crown Prince Sheikh Khaled met OpenAI CEO Sam Altman and witnessed four agreements: ADNOC, with G42 subsidiary Inception42, will deploy OpenAI frontier technology; the Abu Dhabi Government and OpenAI launched an AI-native Machine-Readable Government initiative whose first food-import compliance pilot is already in production; Mubadala will apply AI to investment analysis; and Inception42 and OpenAI signed a five-year partnership. Inference runs inside the UAE.

OpenAI Signs Four Abu Dhabi Agreements: ADNOC Becomes First Energy Company to Deploy Its Frontier Tech, Machine-Readable Government Pilot Already Live

Key Takeaways

  • Four agreements in one signing, spanning government, energy and investment, announced officially by the Abu Dhabi Media Office.
  • ADNOC becomes the first energy company globally to deploy OpenAI frontier technology, powered by GPT models on in-country UAE inference, with human experts keeping oversight of consequential decisions.
  • The Machine-Readable Government initiative turns a defined set of policies and regulations into machine-readable form to help officials with permit and certificate compliance checks, each traceable to the governing rule; its first pilot is already in production with ADAFSA on food imports.
  • Inception42 and OpenAI signed a five-year partnership for government, enterprise and education; Mubadala will use AI for investment analysis and risk assessment.
  • No deal value was disclosed.
Read full story

Meituan ships LongCat-2.5, a 1.6T-parameter (about 48B active) native multimodal agentic model, with API pricing of $0.30/$1.20 per 1M tokens

On Nov 2 Meituan's LongCat team listed LongCat-2.5 in its API platform change log as the full release of September 25's LongCat-2.5-Preview. The official technical blog says it has 1.6 trillion total parameters with about 48 billion activated per token, builds on LongCat-2.0 with stronger native visual understanding and agentic coding, and was trained and served with W4A4 inference on domestic AI accelerators. Vendor-reported scores include 88.4 on Terminal Bench v2.1, 38.5 on Terminal Bench v4.0, 91.9 on BrowseComp and 83.1 on MCP Atlas. The API speaks both OpenAI and Anthropic formats with a 1M-token context and up to 128K output tokens, at a limited-time price of $0.30 per 1M uncached input tokens, $0.006 cached input and $1.20 output.

Meituan ships LongCat-2.5, a 1.6T-parameter (about 48B active) native multimodal agentic model, with API pricing of $0.30/$1.20 per 1M tokens

Key Takeaways

  • Scale: a 1.6-trillion-parameter MoE with about 48B active per token, a 1M-token context and up to 128K output tokens (official blog, API docs)
  • Code agents (vendor-reported): Terminal Bench v2.1 88.4 (Claude Opus 5 89.1, GPT-5.6-Sol 88.8), Terminal Bench v4.0 38.5 (GPT-5.6-Sol 37.3, Claude Opus 5 53.9), DeepSWE v1.1 64.6
  • General agents (vendor-reported): BrowseComp 91.9, MCP Atlas 83.1, AutomationBench v1.0.6 51.8, HLE with tools 63.1; AutomationBench jumps from 15.8 on LongCat-2.0
  • Pricing: limited-time $0.30 per 1M uncached input tokens, $0.006 cached input and $1.20 output (pricing page)
  • Engineering: W4A4 inference raises prefill throughput 43.3% and decode throughput 42.77% over a W8A8 baseline; FSDP gives 86% higher per-device throughput than DDP in long-sequence SFT
Read full story

SenseTime open-sources SenseNova-Loop-9B-Preview, a 9B looped Transformer with about 14.6B inference parameters for long-context and agentic work

On Oct 30, SenseTime released SenseNova-Loop-9B-Preview (Apache 2.0) on its official X account and Hugging Face. It runs layers 4 to 27 of a 32-layer decoder twice with the same weights, so each forward pass executes 56 layer computations while storing about 9B parameters, about 14.6B at inference, and it uses two-stream mHC (manifold-constrained hyper-connections) to manage the residual streams. It takes text and images, with training sequences up to 262,144 tokens. SenseTime charts show it beating Qwen3.5 and Qwen3.6 peers on BIRD-Dev, WorkBuddy Bench, and other agent and data tasks, while it still trails on Terminal Bench 2.1; the technical report is not out yet. The official launch post drew about 910 likes.

SenseTime open-sources SenseNova-Loop-9B-Preview, a 9B looped Transformer with about 14.6B inference parameters for long-context and agentic work

Key Takeaways

  • Structure: 32 distinct decoder layers, with layers 4 to 27 looped twice on shared weights for 56 layer computations per forward pass; about 9B stored and about 14.6B inference parameters (model card)
  • Vendor-reported scores: BIRD-Dev 71.38 (Qwen3.5-27B 69.84), WorkBuddy Bench 66.89 (Qwen3.6-35B-A3B 61.98), AutomationBench 13.72 (Qwen3.5-27B 10.17)
  • Weak spots from the same vendor chart: Terminal Bench 2.1 at 40.45, below Qwen3.6-27B at 47.19; tau3-Banking at 18.56, slightly below Qwen3.5-27B at 19.59
  • Training context up to 262,144 tokens; hybrid attention uses three linear-attention layers plus one full-attention layer per four-layer group; MTP speedup is available, DSpark and DFlash2 are still training
  • Apache 2.0, requires trust_remote_code=True; official examples cover Transformers 5.18.0, a 4-GPU LightLLM setup, and an SGLang PR, and the technical report is still to come
Read full story
Linked Models & Agents:
⚡ SenseNova-Loop-9B-Preview⚡ Qwen3.5-27B⚡ Qwen3.6-35B-A3B🌐 SenseTime

X discussion: Sam Altman calls DRAM sitting in personal PCs "quite terrible", and local-inference fans push back

On the Cheeky Pint podcast with Stripe co-founder John Collison, published October 29, Sam Altman discussed the memory shortage. He said many people assume open-source models and local inference solve the compute crunch, but from a global allocation perspective it is "quite terrible" for everyone to have scarce DRAM sitting in their own computer and being used about 5% of the time, and that a supply-constrained world wants maximum utilization in the cloud. A pubity post quoting him drew more than 26,000 likes and over 8 million views, and many users pushed back that PC memory is not only for AI and that local models matter for privacy and offline use. This is a summary of an X discussion, not a verified conclusion.

X discussion: Sam Altman calls DRAM sitting in personal PCs "quite terrible", and local-inference fans push back

Key Takeaways

  • Source: Sam Altman on the Cheeky Pint podcast, published October 29, with an official transcript that includes "being used 5% of the time"
  • Altman's argument: with DRAM supply tight, memory in personal computers sits mostly idle, while cloud data centers can serve many users continuously, so utilization should be maximized there
  • Engagement (X API, read Oct 31 13:06 SGT): the pubity post had 26,124 likes, 8,557 quotes, 5,210 replies and about 8.06 million views
  • Main pushback: PC memory also runs the OS, browsers and games; local models keep data on the device; some note the view matches OpenAI's cloud business model
  • Altman did not explain the 5% figure, and coverage suggests treating it as a rough estimate, not a measurement
Read full story
Linked Models & Agents:
ADSponsored

Google Project Suncatcher runs its first in-orbit TPU inference, with Gemma 4 writing a haiku

On Oct 30 Google CEO Sundar Pichai announced a "hello world" milestone for Project Suncatcher on X: the team sent a command to the prototype satellite in orbit, booted the TPU, ran a prompt and received the first complete response back on Earth, a haiku. TechCrunch reports the reply came from Gemma 4 preloaded on the satellite.

Google Project Suncatcher runs its first in-orbit TPU inference, with Gemma 4 writing a haiku

Key Takeaways

  • The prototype launched Oct 1 on SpaceX Transporter-18 and ran its first in-orbit inference after about three weeks of commissioning (commissioning time per TechCrunch)
  • Per TechCrunch the onboard model is Google DeepMind's Gemma 4, and the first prompt asked for a haiku about being in space
  • TechCrunch says the satellite generates up to about 1 kW and the TPU can run only about 20 minutes at a time; TPU count differs by source (Google's earlier X post said four, TechCrunch says one)
  • Next step is two more satellites in 2027 to test higher power and inter-satellite optical links; Google has published no throughput or benchmark numbers
Read full story

OpenAI launches Private Intelligence for enterprises: Zero Data Retention, Private Inference preview and agent approval controls

On Oct 30 OpenAI introduced Private Intelligence, a business privacy offering that bundles Zero Data Retention, a Private Inference confidential-computing preview for the API, agent access and approval controls, encryption and compliance certifications across ChatGPT, Codex and the API, built with some of its largest customers.

OpenAI launches Private Intelligence for enterprises: Zero Data Retention, Private Inference preview and agent approval controls

Key Takeaways

  • Covers three product lines, ChatGPT, Codex and the API, with per-product controls documented by OpenAI
  • Private Inference ships as an API preview that OpenAI describes as confidential computing with strict, verifiable controls
  • Businesses set agent data access, available tools, permitted actions and required approvals before agents act
  • OpenAI lists SOC 2 Type 2, ISO certifications, HIPAA BAAs and FedRAMP support; no benchmarks or pricing were published
Read full story

LM Studio Bionic 1.1.10 adds the oMLX engine, bringing RAM-plus-SSD KV caching and MLX speculative decoding to local models on Macs

LM Studio posted on X at 15:32 UTC on Oct 29 that users can now download a new oMLX engine inside LM Studio and run it with MLX models they already have. The official changelog lists it in Bionic 1.1.10, alongside speculative decoding for MLX models and an in-app terminal. oMLX is an open-source Apple Silicon inference server maintained by developer jundot (Apache 2.0, about 23,000 GitHub stars) built around continuous batching and a two-tier RAM and SSD KV cache. LM Studio has not published speed comparisons for the engine.

LM Studio Bionic 1.1.10 adds the oMLX engine, bringing RAM-plus-SSD KV caching and MLX speculative decoding to local models on Macs

Key Takeaways

  • LM Studio says the oMLX engine can now be downloaded inside the app and used with existing MLX models; the post has about 540 likes (post)
  • The Bionic 1.1.10 changelog (Oct 29) also lists speculative decoding for MLX models, a public in-app terminal and llama.cpp 2.66.0 extension packs (changelog)
  • oMLX is Apache 2.0 open source with about 23,000 GitHub stars and needs macOS 15+ on Apple Silicon M1 to M5 (GitHub)
  • Its core is a two-tier KV cache: hot blocks stay in RAM, overflow is written to SSD as safetensors, and matching prefixes are restored from disk even after a restart
  • LM Studio has published no speed comparison with its existing MLX engine; one user reported that restart-to-update failed after launch and LM Studio is investigating
Read full story

Anthropic details Claude self-assessment for misuse detection: 78% recall at 1% false positives for under 2% extra compute

On Oct 29 Anthropic introduced self-assessment on X: after each response, Claude produces a structured preliminary safety assessment of the whole conversation for offline review. Anthropic's Safeguards blog says that on Claude Fable 5, at a 1% false-positive rate, it flags 78% of the conversations a stronger prompted classifier flags and 94% of high-priority ones. Because the conversation is already in the KV cache, it adds about 10 output tokens on average and an estimated under 2% of inference compute. It has run in production since June, but Anthropic says it is not robust against an attacker who targets it directly and is only one layer of defense in depth.

Anthropic details Claude self-assessment for misuse detection: 78% recall at 1% false positives for under 2% extra compute

Key Takeaways

  • On Claude Fable 5, at a 1% false-positive rate it recalls 78% of what the prompted classifier flags and 94% of high-priority (7+) conversations (vendor figures, Safeguards blog)
  • It reuses the KV cache, adding about 10 output tokens per assessment on average; Anthropic estimates under 2% extra inference compute and does not bill customers for it
  • Across four model sizes, recall at 1% false positives rises from about 16% to about 96% and AUC from 0.862 to 0.995
  • As a real-time blocker it is weak: attack success on 24 cyber tasks only drops from 79% to 54%, versus 25% with a prompted classifier
  • In August it raised over 100k child sexual abuse flags from a single API customer, reported to NCMEC; about a third of flags fall outside the existing taxonomy
Read full story
Linked Models & Agents:

Mistral launches its Responses API in public preview: OpenAI Responses-compatible, returning the answer, reasoning and tool calls as separate items for building agents

Mistral AI announced on X on Oct 28 that its Responses API is in public preview, positioned as the interface for building agents on Mistral. The official docs say it uses the OpenAI Responses format, and each response's output array carries the models messages, its reasoning and its function calls as separate items, which is easier to handle step by step than Chat Completions. The preview is stateless, so the app keeps the conversation history and sends it back; it supports text, image and file input, JSON Schema structured output, streaming events, client-executed function calls, reasoning.effort, and token counting via POST /v1/responses/input_tokens. It is served in the EU and US on Mistral AI Cloud Inference. The same thread says Mistral now also serves DeepSeek V4.1 Flash (public preview) and GLM 5.3 Flash (generally available).

Key Takeaways

  • The Responses API is in public preview and uses the OpenAI Responses format, so existing Responses integrations can move to Mistral more easily
  • Each response splits the answer, reasoning and function calls into separate output items, which suits step-by-step agent loops
  • The preview is stateless: the app keeps the history and sends earlier output items back along with function_call_output results
  • It supports image and file input, JSON Schema structured output, streaming, function calling (including namespaces), reasoning.effort and token counting via /v1/responses/input_tokens
  • It is served in the EU and US on Mistral AI Cloud Inference; Mistral also added DeepSeek V4.1 Flash (preview) and GLM 5.3 Flash (GA)
Read full story