Xinference v3.5.0 Released: Native YuE2 Music Generation, MinerU2.5 PDF Parsing & Apple MLX Audio Models
Open-source distributed model serving engine Xinference (xorbitsai/inference) shipped v3.5.0, substantially upgrading its multimodal inference and edge acceleration capabilities. The release adds out-of-the-box support for YuE2 music generation, alongside AuK/AuK-Flash and Irodori TTS v4.1. On Apple Silicon, Xinference introduces native Apple MLX hardware acceleration for FishAudio-S2-Pro, Irodori TTS Small, and Breeze TTS 2. On the visual and document AI front, it integrates MinerU2.5 for complex document parsing and LingBot-World-V2 for embodied world simulation, while introducing distributed correlation metadata propagation across actor calls for enterprise observability.
Key Takeaways
- Generative audio expansion: native support for YuE2 music generation plus AuK, AuK-Flash, and Irodori TTS v4.1
- Apple MLX acceleration: brings native MLX execution for FishAudio-S2-Pro, Irodori TTS Small, and Breeze TTS 2 on Apple Silicon
- Document AI & World Models: out-of-the-box deployment for MinerU2.5 document parsing and LingBot-World-V2 world simulation
- Distributed correlation tracing: propagates correlation metadata across actor calls for seamless multi-agent debugging
- Enterprise audit controls: opt-in model request logging and refined virtualenv package management in the web dashboard
Linked Models & Agents: