AI Coding Live News

LM Studio posted on X at 15:32 UTC on Oct 29 that users can now download a new oMLX engine inside LM Studio and run it with MLX models they already have. The official changelog lists it in Bionic 1.1.10, alongside speculative decoding for MLX models and an in-app terminal. oMLX is an open-source Apple Silicon inference server maintained by developer jundot (Apache 2.0, about 23,000 GitHub stars) built around continuous batching and a two-tier RAM and SSD KV cache. LM Studio has not published speed comparisons for the engine.

Zoom

The Ornith AI team officially released Ornith-1.5-122B under the permissive MIT license, a 122-billion parameter mixture-of-experts (MoE) reasoning model optimized to execute on a single GPU node (such as a single DGX). The model is immediately available across vLLM (0.19.1+), SGLang (0.5.9+), Hugging Face, and Ollama (ornith-1.5:122b) with native FP8, GGUF, and MLX quantization. Across independent agentic evaluations in the OpenHands harness, Ornith-1.5-122B registered 84.5 on SWE-bench Verified, 76.9 on SWE-bench Pro (surpassing Qwen3.8-Flash-Next's 43.9 by 33 points), 81.2 on TerminalBench 2.1, and 74.6 on MCP-Atlas.

Zoom

On 2026-10-15 Meta released Muse Spark Open open weights: an 816B-total / 42B-active MoE with a Perception Encoder, natively multimodal (text/image/video/audio in → text out), 1M context, aimed at coding and long-horizon agents. Weights are on Hugging Face (BF16/NVFP4), SageMaker, Model Garden and Foundry; APIs include OpenRouter, Together, Fireworks and Groq. Meta calls it the most capable US open-weight model to date and, with Apple, optimized it to run locally across two M5 Ultra Mac Studios via MLX.

Zoom

On Oct 13 Liquid AI released LFM2.5-24B-A2B, the largest and final LFM2.5 model: 24B total parameters, ~2.45B active per token, 131K context, and always-on reasoning. By Liquid's own numbers it leads or matches Qwen3.6-35B-A3B on 5 of 8 tool-use/agent benchmarks (AutomationBench 27.69 vs 8.72) while trailing on SWE-Bench Verified, GPQA and other knowledge/coding tests. Open weights are on Hugging Face with GGUF, MLX, FP8 and ONNX builds; API pricing is $0.10 / $1.00 per million tokens and it is also on OpenRouter.

Zoom

Ollama shipped v0.35.0 on 2026-09-28 (GitHub prerelease): Decision Models via TypeSafe’s Jev API at /v1/systemone. Instead of free text, models answer choice/noul/score questions with options, probabilities, and confidence—for ticket triage, model routing, and classification. First models: Nimble (Bespoke Labs) and Tev1 (Together AI). ~7 commits / 66 files vs v0.34.4; Settings no longer blocks on discovery; macOS update menu and stalled MLX downloads fixed.

Zoom

Open-source distributed model serving engine Xinference (xorbitsai/inference) shipped v3.5.0, substantially upgrading its multimodal inference and edge acceleration capabilities. The release adds out-of-the-box support for YuE2 music generation, alongside AuK/AuK-Flash and Irodori TTS v4.1. On Apple Silicon, Xinference introduces native Apple MLX hardware acceleration for FishAudio-S2-Pro, Irodori TTS Small, and Breeze TTS 2. On the visual and document AI front, it integrates MinerU2.5 for complex document parsing and LingBot-World-V2 for embodied world simulation, while introducing distributed correlation metadata propagation across actor calls for enterprise observability.

Zoom

Local LLM inference runtime Ollama (@ollama) officially rolled out v0.40.0. The standout architectural milestone is the default adoption of Apple's native MLX framework on all Apple Silicon Mac devices (M1 through M5), replacing the legacy CPU/Metal compute paths. Supporting major architectures like Qwen 3.8 and Llama 3 natively, the update harnesses Apple's unified memory bandwidth, slashing time-to-first-token by 42% and nearly doubling continuous generation throughput without manual configuration.

Zoom