Models & Labs
vLLM v0.19.0 Released with New Features
vLLM Releaseshigh confidence
Why it matters
- →The addition of Gemma 4 support expands the capabilities of vLLM for advanced AI applications. • Performance improvements in async scheduling and model handling can significantly enhance throughput for developers. • Compatibility with HuggingFace Transformers v5 ensures broader usability across popular AI frameworks.
vLLM has announced the release of version 0.19.0, which includes 448 commits from 197 contributors, with 54 new contributors. Key features include full support for Google Gemma 4 architecture, zero-bubble async scheduling with speculative decoding, and enhancements to the Model Runner V2. This update also introduces compatibility with HuggingFace Transformers v5 and various optimizations for NVIDIA hardware. The release aims to improve throughput and performance for a range of models and applications.
Read originalMore from vLLM Releases
More in Models & Labs
Models & Labsother
New release of llama.cpp b8991
The latest version b8991 of llama.cpp has been released, featuring updates for various operating systems.
llama.cpp Releases
Models & Labsother
llama.cpp update enhances compatibility and performance
The latest update to llama-mmap improves compatibility with various platforms and model sizes. Key enhancements include support for 32-bit wasm and updates to gguf.cpp style.
llama.cpp Releases
