Models & Labs

vLLM v0.22.0 Release Enhances Model Performance

vLLM ReleasesMay 31, 2026high confidence

Why it matters

→The update significantly enhances model accuracy and efficiency with new support for NVFP4 fused MoE.
→The introduction of a Rust frontend and batch-invariant inference improvements increase flexibility and speed.
→These advancements make vLLM a more capable framework for complex AI tasks.

The vLLM project has released version 0.22.0, featuring substantial improvements across its AI model infrastructure. This update includes 459 commits from 230 contributors, focusing on enhancing model performance and efficiency. Key advancements include the reorganization of the DeepSeek V4 model and the introduction of NVFP4 fused MoE support, which aim to improve accuracy and processing speed. The Model Runner V2 now defaults to Qwen3 dense models, enhancing performance with new features like sleep-mode weight reload. These updates position vLLM as a more robust framework for handling complex AI tasks.

Read original

More from vLLM Releases

Models & Labsmodels

vLLM v0.20.2 Patch Release

The vLLM v0.20.2 release is a minor update focusing on bug fixes for DeepSeek V4, gpt-oss, and Qwen3-VL. This patch addresses specific issues such as the MTP=1 hang on DeepSeek V4 by re-enabling the persistent topk path and fixing a KV cache allocation error. For gpt-oss, the update ensures compatibility with MXFP4 under torch.compile, while Qwen3-VL sees the removal of an invalid boundary check. These fixes enhance the stability and performance of the models, ensuring smoother operations under various conditions.

vLLM ReleasesMay 29, 2026

More in Models & Labs

Models & Labsmodels

Llama.cpp Update Fixes iGPU Device Selection

Llama.cpp has addressed a critical issue in its device selection logic that affected systems using integrated GPUs as their main compute device. Previously, the presence of any RPC server would cause the local iGPU to be ignored, leading to model loading failures. This update ensures that iGPUs are included unless no GPUs are available, allowing for proper tensor allocation and model loading on systems like the Strix Halo with significant unified memory. This fix enhances the reliability of llama.cpp on diverse hardware configurations.

llama.cpp ReleasesMay 31, 2026

Models & Labsmodels

llama.cpp b9434 release focuses on GPU granularity

The b9434 release of llama.cpp targets granularity improvements for Qwen 3.5/3.6 across three GPUs, offering a technical refinement rather than a major overhaul. This update is crucial for developers optimizing performance on specific GPU setups, enhancing compatibility and efficiency. While it doesn't bring new models or groundbreaking features, it extends support to platforms like macOS, Linux, and Windows. The release ensures that llama.cpp continues to be a flexible tool for developers, focusing on incremental improvements that enhance its utility without introducing radical changes.

llama.cpp ReleasesMay 31, 2026

Models & Labsmodels

Llama.cpp Adds Custom CSS Injection Feature

Llama.cpp's latest update introduces a new feature allowing users to inject custom CSS via the configuration settings. This enhancement enables operators to theme prebuilt binaries without the need for rebuilding, offering greater flexibility in UI customization. The update also includes a migration to a new custom JSON key, ensuring compatibility with existing configurations. This change empowers users to personalize their interface more easily, making the tool more adaptable to individual preferences.

llama.cpp ReleasesMay 31, 2026