Kandinsky 6.0 Video Released: Open-Source Foundation Models for Synchronized 1080P Video and 44kHz Audio Generation
Generating cinematic video accompanied by synchronized, high-fidelity audio represents a premier frontier in multimodal AI. Traditional pipelines rely on disjointed workflows where silent video is generated first and audio is patched in post-hoc, leading to temporal misalignment, unnatural ambient acoustics, and broken lip-sync. The Kandinsky research team releases Kandinsky 6.0 Video (arXiv:2610.05608, code: github.com/kandinskylab/kandinsky-6, Hugging Face Diffusers integration). Powered by a dual-stream CrossDiT (Diffusion Transformer) architecture, Kandinsky 6.0 Video tightly couples a pretrained video generation stream with a newly trained audio stream via bidirectional cross-attention for joint temporal-semantic alignment. Available in two configurations—a 3B Lite variant and a 29B Pro flagship—the model generates 5-second video sequences accompanied by synchronized 44 kHz broadcast-grade audio, featuring native lip-sync and integrated Full-HD (1920x1080) super-resolution. The codebase, model weights, and Diffusers integration are fully released under the permissive MIT license.
Key Takeaways
- Kandinsky 6.0 Video released under MIT license, delivering synchronized audiovisual generation from text and images
- Dual-stream CrossDiT architecture outputs 5s video with 44 kHz broadcast audio and Full-HD 1080p resolution
- Provides 3B Lite and 29B Pro weights, slashing audiovisual alignment error by 62.4% with native lip-sync