Meta Rolls Out Muse Realtime Avatar in the US Muse App: Speech-Driven Expression and Gesture at ~870ms First-Byte Latency
On November 5 Meta AI (@AIatMeta) said Muse Realtime Avatar, previewed at Connect, is rolling out in the US Muse app, turning Muse Realtime Voice into interactive live avatars. The research blog describes an audio-driven Diffusion Transformer that shares the speech-token stream with voice for lip-sync and expression; a single GB200 session streams 448×768 at 25 fps with about 870 ms from end of user turn to first synchronized audio-video byte, with Meta Video Seal invisible watermarking. Muse is for users 18+; no global schedule or developer API was announced.
Key Takeaways
- US Muse app rollout of Realtime Avatar after the Connect preview (@AIatMeta)
- Shared speech VQ tokens drive audio decode and avatar video; causal chunks with self-forcing distillation cut ~120 teacher NFEs to 2 student NFEs (~60x)
- Vendor perf: 448×768@25fps, ~870ms first-byte latency; ~8x serving capacity vs BF16 baseline, up to 12 concurrent sessions on one GB200
- Vendor preference study favored Muse over Runway Characters and HeyGen LiveAvatar on overall and most axes
- Safety: Video Seal invisible watermark; blog demos are not the full in-app avatar set; no public developer API stated








