
Liquid AI has released LFM2.5-VL-DSpark, a speculative decoding drafter designed to accelerate vision-language models on both edge devices and datacenter GPUs. The open-weight drafter adds just 280M parameters (8.9% overhead) to the target model while achieving up to 3.13x faster decoding on Apple Silicon M5 Max chips and 2.66x speedups on NVIDIA H100s. It ships with immediate integration support for llama.cpp, MLX-VLM, and SGLang, allowing developers to deploy faster VLM inference without rewriting their inference stacks. The release underscores a growing industry shift toward optimizing inference efficiency through specialized drafters rather than solely increasing model scale.
Read originalThis release quietly expands llama.cpp's hardware support to include Qualcomm's Hexagon NPU on Linux arm64, a significant step for local inference on Snapdragon devices. It also updates CUDA builds to version 13.4 and introduces ROCm 10.0 binaries, keeping the project aligned with the latest NVIDIA and AMD driver ecosystems. KleidiAI on Apple Silicon is temporarily disabled in this build, likely due to stability checks rather than a feature rollback. For developers targeting edge AI or diverse GPU stacks, this update ensures broader compatibility without requiring custom compilation.
© Lev SelectorNVIDIA introduced the NVFP4 4-bit format and SoL-Pi technology, which uses 2x fewer tokens for improved efficiency.
© Lev SelectorAnthropic released Claude Opus 5.5 on September 22, while OpenAI launched GPT-6 Sol and Luna variants, advancing frontier model capabilities.