AI Coding Live News

On November 5 Meta AI (@AIatMeta) said Muse Realtime Avatar, previewed at Connect, is rolling out in the US Muse app, turning Muse Realtime Voice into interactive live avatars. The research blog describes an audio-driven Diffusion Transformer that shares the speech-token stream with voice for lip-sync and expression; a single GB200 session streams 448×768 at 25 fps with about 870 ms from end of user turn to first synchronized audio-video byte, with Meta Video Seal invisible watermarking. Muse is for users 18+; no global schedule or developer API was announced.

Zoom

On November 4, Justin Uberti, Head of Realtime AI at OpenAI, said the GPT-Live outbound telephony API is generally available: Live voice agents can dial through any SIP trunk such as Telnyx or Twilio, with HD Voice and bidirectional DTMF. Official docs describe Live API + SIP transport; Greg Brockman amplified the note.

Zoom

On November 2 voice AI company Hume launched the Audio Decision API, which it calls the first audio-native model that answers questions about speech and sound. Developers upload raw audio, write each question as a sentence with candidate answers, and get back a probability for each answer, with no transcription step. It supports yes/no, multiple-choice, rating-scale and time-span questions, such as how many speakers there are, whether someone laughs, whether a caller sounds frustrated, or whether a siren is in the background. Per Hume, it was trained on more than 10 million human judgments and in an initial evaluation reached 70.7% agreement with a human panel's average judgment, versus 56.5% for an individual rater. Access is currently by request or waitlist.

Zoom

Anomaly, the company behind open-source coding agent OpenCode, shipped Hex 3.0 stable: hold a shortcut, speak, and the text is pasted at your cursor. Recognition runs on-device, local model memory drops from about 900 MB to about 160 MB, and it adds vocabulary hints, a hex CLI and optional OpenCode rewriting.

Zoom

Voice model company Cartesia launched Managed Agents on Oct 29, an end-to-end voice agent platform for enterprise phone calls that tunes its own speech-to-text and text-to-speech models together with the agent harness, and bundles telephony, knowledge bases, tool calls and outbound batches. Cartesia says it ranks #1 on Artificial Analysis's Speech Agent Arena with a 1115 Elo and scores 87.4% accuracy and 90.7% experience on ServiceNow's EVA-Bench (vendor-reported, with GPT-5.5 as the reasoning model). Launch pricing is 50% off at $0.03 per minute.

Zoom

On Oct 28 OpenAI announced through @ChatGPT that users can now text their dot, the always-on agent inside ChatGPT. You can hand it a task or something to watch using text, photos or voice notes, and it texts you proactively when there is a relevant update. Texting runs over iMessage or RCS, not plain SMS; only you can text your dot and it can only text you. It is rolling out in beta to a limited number of US Pro users and is not supported in Business or Enterprise workspaces. Texts pass through the third-party provider Linq, and OpenAI says the conversation is not end-to-end encrypted.

Zoom

On Oct 26 Apple released iOS, iPadOS, macOS, watchOS and visionOS 27.2, and Siri AI (beta), the assistant rebuilt on Apple Intelligence, now supports French, Japanese, Korean, Portuguese and Spanish in addition to English. Apple says Traditional Chinese, Norwegian, Turkish and Vietnamese will follow by the end of the year. Per the iOS 27.2 release notes, Siri AI can now recall past conversations and draw on more sources such as photos in Messages, Calendar attendees and voicemails. Siri AI is still unavailable in the EU on iOS, iPadOS and watchOS and in mainland China, and server-side features have daily usage limits; Apple says expanded access will be offered for a fee in the future.

Zoom

On Oct 26 Tencent Hunyuan (Tencent Hy) open-sourced Hy-SimulMT, a real-time simultaneous interpreting model for bidirectional Chinese-English speech-to-speech translation. It translates while the speaker talks, outputs both translated text and speech, and can clone the speaker's voice in real time. Six checkpoints landed on Hugging Face (30B-A3B translation-only and source-plus-translation Interleave variants, each in BF16, FP8 and GGUF), with the model card listing Apache-2.0; GitHub ships the SimulInfer serving stack and SimulTrain training tools. Vendor-reported: about 3s StreamLAAL on RealSI long-form audio, the lowest among compared systems.

Zoom

Mistral AI unveiled Voxtral 3, a production audio intelligence suite paired with a real-time Voice-Agent API. The lineup features the 4B-parameter Mini Transcribe, Small Transcribe 3, and a turn-key voice agent SDK built on LiveKit. Supporting transcription across 50 languages with diarization, multi-lingual TTS with emotional tags across 35+ languages, and 30-minute voice cloning, Voxtral 3 redefines voice AI economics. In Artificial Analysis independent benchmarks, Small Transcribe 3 secured rank #3 globally with a 2.1% error index (outperforming ElevenLabs Scribe v2), while Realtime Transcribe delivers sub-500ms latency at $0.04/min for full voice agent turns.

Zoom

On Oct 20, the FastVideo team at UCSD's Hao AI Lab open-sourced FastH3 Omni, a distilled version of MiniMax H3's reference-to-video-and-audio (Ref2VA) model that generates video with synchronized stereo audio from text plus up to nine images, video clips and voice references. Sampling drops from 50 steps to eight transformer evaluations, cutting end-to-end latency 5.6-11.9x on eight GB200s by the team's measurements. Training code is open, with NVFP4 weights for DGX Spark and RTX 5090 and ComfyUI support.

Zoom

On Oct 20, French voice AI company Gradium open-sourced Phonon, a family of on-device text-to-speech models: the English Phonon 31m (64 MB q8 weights, Apache 2.0) and Phonon 40m (single-language English, French, German, Spanish and Portuguese variants plus a five-language model, CC BY-NC non-commercial). Built on Kyutai's Pocket TTS and the Mimi codec, it ships its own runtime for CPU, Metal, CUDA, Vulkan, WebGPU, Core ML and Snapdragon, running offline on phones, browsers and a Raspberry Pi. Gradium reports 7 ms to first audio on a MacBook Air M5 CPU versus 517 ms for Kokoro.

Zoom

On Oct 20 ElevenLabs released Eleven Realtime, end-to-end speech-to-speech models where each model is a complete voice agent, removing the need to wire up speech recognition, an LLM and text-to-speech yourself. v1 Mini targets low-cost natural conversation and v1 Max targets support and multi-step tool use. Both cover 90+ languages and 17,000+ voices. Citing independent Artificial Analysis evals, Max answers 98.8% of Big Bench Audio correctly and starts speaking in 0.57s on average. The API is OpenAI Realtime compatible, so migrating means changing the endpoint and model name.

Zoom