Models & Labs
vLLM v0.25.0 Release Enhances Model Execution
vLLM Releaseshigh confidence
Why it matters
- →Model Runner V2 as default enhances execution efficiency for dense models.
- →New models and backend improvements expand developer options and capabilities.
- →Removal of legacy components streamlines performance and reduces complexity.
vLLM has released version 0.25.0, introducing Model Runner V2 as the default for all dense models, enhancing execution with features like real-time embeddings and dynamic speculative decoding. The update also removes the legacy PagedAttention, streamlining the platform's performance. New models such as LLaVA-OneVision-2 and Unlimited OCR have been added, expanding the model zoo. These changes aim to improve efficiency and broaden the capabilities available to developers using vLLM.
Read originalThe story around this
Earlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.
How we got here
More from vLLM Releases
More in Models & Labs
Models & Labsother
llama.cpp b11193 adds Snapdragon Hexagon and ROCm 10
This release quietly expands llama.cpp's hardware support to include Qualcomm's Hexagon NPU on Linux arm64, a significant step for local inference on Snapdragon devices. It also updates CUDA builds to version 13.4 and introduces ROCm 10.0 binaries, keeping the project aligned with the latest NVIDIA and AMD driver ecosystems. KleidiAI on Apple Silicon is temporarily disabled in this build, likely due to stability checks rather than a feature rollback. For developers targeting edge AI or diverse GPU stacks, this update ensures broader compatibility without requiring custom compilation.
llama.cpp Releases
© Lev SelectorModels & Labsmodels
NVIDIA NVFP4 and SoL-Pi Token Efficiency
NVIDIA introduced the NVFP4 4-bit format and SoL-Pi technology, which uses 2x fewer tokens for improved efficiency.