AICoder

AI Coding Live News

First-hand AI coding updates from 𝕏/Twitter frontier labs and researchers, distilled by AI with entity benchmarks.

Explore live on 𝕏 ↗

AI Coding Live News

M
Mistral AI@MistralAI·
👀73
🔥97
View on 𝕏 ↗

Mistral Releases Voxtral 3 Audio Model Suite and Real-Time Voice-Agent API with Sub-500ms Latency

Mistral AI unveiled Voxtral 3, a production audio intelligence suite paired with a real-time Voice-Agent API. The lineup features the 4B-parameter Mini Transcribe, Small Transcribe 3, and a turn-key voice agent SDK built on LiveKit. Supporting transcription across 50 languages with diarization, multi-lingual TTS with emotional tags across 35+ languages, and 30-minute voice cloning, Voxtral 3 redefines voice AI economics. In Artificial Analysis independent benchmarks, Small Transcribe 3 secured rank #3 globally with a 2.1% error index (outperforming ElevenLabs Scribe v2), while Realtime Transcribe delivers sub-500ms latency at $0.04/min for full voice agent turns.

Mistral Releases Voxtral 3 Audio Model Suite and Real-Time Voice-Agent API with Sub-500ms Latency

Key Takeaways

  • Mistral AI launched the Voxtral 3 suite spanning transcription, emotional TTS, studio-grade voice cloning, and a LiveKit-powered Voice-Agent SDK
  • Artificial Analysis independently verified Small Transcribe 3 at a 2.1% error index, outperforming ElevenLabs Scribe v2 (2.2%) and Grok Voice 2.0 (2.3%)
  • Realtime Transcribe 3 achieves sub-500ms latency, delivering sub-second full conversational voice-agent turns
  • Aggressive pricing: Mini Transcribe starts at $0.0035/min, and managed voice agent sessions cost just $0.04/min paired with Mistral Small 4
Read full story
Linked Models & Agents:
⚡ Voxtral 3⚡ Mistral Small 4🤖 Mistral Voice Agent🌐 Mistral AI🌐 LiveKit
#Mistral AI#Voxtral 3#Voice Agent#STT#TTS#Artificial Analysis#LiveKit
M
Mistral AIMistralAI·
👀111
🔥86
View on 𝕏 ↗

Mistral launches the Voxtral 3 speech model family and a voice agent SDK: transcription in 50+ languages, TTS at $13 per 1M characters, EU-hosted or self-deployed

On Oct 20 Mistral released Voxtral 3: the Voxtral Small/Mini Transcribe 3 speech-to-text models, Voxtral Mini Transcribe Realtime 3, the Voxtral Mini TTS 3 (Voxtral Speech 3) text-to-speech model, and a LiveKit-based voice agent SDK that streams listening, reasoning with tool calls, and speaking as one pipeline, with each turn completing in under a second per Mistral. Transcription covers 50+ languages with diarization and context biasing; TTS covers 35+ languages and 50+ dialects, plus Pro Voice cloning from 30 minutes of audio. It is live on the Mistral API (EU, US and global endpoints) and can be self-deployed.

Mistral launches the Voxtral 3 speech model family and a voice agent SDK: transcription in 50+ languages, TTS at $13 per 1M characters, EU-hosted or self-deployed

Key Takeaways

  • Multilingual transcription (vendor-reported): macro WER over 45 FLEURS languages is 4.1% (language forced) / 4.0% (inferred) for Voxtral Small Transcribe 3, tied with Microsoft AI Transcribe 2 and ahead of Scribe v2 (4.9%) and Whisper large-v3 (16.0%/14.9%)
  • Diarization (vendor-reported): cpWER of 18.4% for Small and 18.6% for Mini, vs 30.9% for the previous Voxtral Mini Transcribe 2 and 38.4% for Gemini 3.5 Transcribe
  • Pricing: Voxtral Mini Transcribe 3 is 4B parameters at $0.0035/min (docs list it as Public Preview with 32k context); Voxtral Speech 3 costs $13 per 1M characters
  • Realtime: Voxtral Mini Transcribe Realtime 3 runs below 500 ms latency; in Mistral's 35-language FLEURS chart the 480 ms setting scores 6.4% WER, still behind Gemini 3.5 Realtime Transcribe at 4.2%
  • The voice agent SDK is built on LiveKit with SIP telephony and WebRTC; each stage (LLM, voice, language) is swappable, and Pro Voice clones a voice from 30 minutes of audio
Read full story
Linked Models & Agents:
⚡ Voxtral Small Transcribe 3⚡ Voxtral Mini Transcribe 3⚡ Voxtral Mini Transcribe Realtime 3⚡ Voxtral Mini TTS 3🤖 Voxtral voice agent SDK🌐 Mistral AI🌐 LiveKit
#ASR#TTS#Mistral#Voxtral 3#LiveKit
H
Hugging Face@huggingface·
👀85
🔥94

Hugging Face Transformers 5.18.0: Nemotron 3 streaming diarization; NemotronH Omni; HyperCLOVAX Vision V2; GTE

Hugging Face shipped transformers v5.18.0 on 2026-09-30 (PyPI 5.18.0): NVIDIA Nemotron 3 Diarization (streaming/offline, up to 8 speakers, 80 ms–30.4 s buffers), NemotronH Omni (joint text/image/video/audio), NAVER HyperCLOVAX Vision V2 (built-in <think> CoT), and GTE bidirectional encoders (RoPE + gated MLP; gte / snowflake-arctic-embed family). Official model_doc pages are live.

Hugging Face Transformers 5.18.0: Nemotron 3 streaming diarization; NemotronH Omni; HyperCLOVAX Vision V2; GTE

Key Takeaways

  • Release v5.18.0 at 2026-09-30T16:46:27Z; PyPI ~2026-09-30T16:45:57Z
  • Nemotron 3 Diarization: streaming+offline, ≤8 speakers, 80 ms–30.4 s buffers, 10 ms frame multiples (#49056)
  • NemotronH Omni: NemotronH + RADIO + optional Parakeet for joint text/image/video/audio (#46509)
  • HyperCLOVAX Vision V2 (NAVER) + GTE encoders (RoPE/gated MLP; gte / snowflake-arctic-embed family)
  • pip install -U transformers==5.18.0; docs for diarization/omni/gte linked above
Read full story
Linked Models & Agents:
⚡ Nemotron 3 Diarization⚡ Nemotron H Omni⚡ Hyperclovax Vision V2⚡ gte🌐 huggingface🌐 Nvidia (NIM)🌐 naver
#Transformers#Huggingface#Nemotron#Diarization#Multimodal#Hyperclovax#Gte#Release
x
xAI@SpaceXAI·
👀39
🔥96
View on 𝕏 ↗

xAI ships Grok Voice Transcribe 2.0: ~2× accuracy, $0.10/hr batch, AA streaming #1

SpaceXAI (xAI) launched Grok Voice Transcribe 2.0, claiming roughly 2× the accuracy of Transcribe 1.0 on customer-support calls, spoken credentials, and short voice commands at the same price. It ranks #1 for accuracy among 32 streaming transcription models on Artificial Analysis; short-phrase WER fell from about 20.6% to 6.8%. Features include streaming and batch modes, automatic language detection with mid-recording language switches, word-level timestamps and confidence, free speaker diarization, batch at about $0.10/hour and realtime streaming at about $0.20/hour, with existing Speech-to-Text API clients upgraded without code changes.

Key Takeaways

  • Claims ~2× accuracy vs Transcribe 1.0 on support calls, spoken credentials, and short commands at the same price.
  • #1 accuracy among 32 AA streaming transcription models; short-phrase WER ~20.6%→6.8%.
  • Batch ~$0.10/hr and streaming ~$0.20/hr, with diarization, language switching, word timestamps; existing API clients upgrade in place.
Read full story
Linked Models & Agents:
⚡ Grok Voice Transcribe 2🌐 xAI
#Grok Voice Transcribe#Speech to text#ASR#xAI#Artificial Analysis#Voice API
ADSponsored
Q
Qwen@Alibaba_Qwen·
👀56
🔥93
View on 𝕏 ↗

Alibaba Qwen launches Qwen3.8-LiveTranslate for 60-language real-time interpretation

Qwen announced Qwen3.8-LiveTranslate, its next-generation real-time simultaneous interpretation model. An Interleave architecture improves faithfulness, fluency, and conciseness while cutting average lagging (LAAL) from 2.8s to 2.3s across 60 languages. New capabilities include real-time speaker diarization with more stable voice cloning, synchronized bilingual display, and long-context disambiguation for names and terminology.

Key Takeaways

  • Interleave architecture cuts average lagging (LAAL) from about 2.8s to 2.3s across 60 languages.
  • Real-time speaker diarization keeps each speaker's voice more stable in multi-party speech.
  • Adds synchronized bilingual display and long-context term disambiguation; try it on QwenCloud.
Read full story
Linked Models & Agents:
⚡ Qwen3 8 Livetranslate🌐 alibaba🌐 Qwen (通义千问)
#Qwen3.8-LiveTranslate#Qwen#Alibaba#real-time translation#Speech#QwenCloud
M
Meta AI Research@AIatMeta·
👀50
🔥91
View on 𝕏 ↗

Meta ships Muse Voice Transcribe: real-time multilingual ASR with 20+ speaker diarization

Meta Superintelligence Labs launched Muse Voice Transcribe on September 1, its first real-time audio perception model: streaming ASR, diarization for 20+ speakers, and endpointing, with native code-switching, 70+ training languages (25 validated at launch), and hour-plus sessions. Meta says it ranks first on Artificial Analysis streaming speech-to-text as of September 1. It already powers Meta AI for Mac (hold Fn to dictate anywhere) and Muse Code, and is on the Meta Model API at $3 per 1,000 audio-minutes (~$0.18/hour).

Key Takeaways

  • Streaming ASR, diarization, and endpointing ship as one model without a post-process chain
  • Already live for system-wide Mac dictation and Muse Code; developers use the Meta Model API
  • API pricing is about $0.18/hour; adaptive delay trades latency for harder words
Read full story
Linked Models & Agents:
⚡ Muse Voice Transcribe⚡ Muse Spark🤖 muse-code🌐 Meta AI
#Muse Voice Transcribe#Meta#ASR#Diarization#Muse Code#Speech
You've caught up with all stories