Models & Labs
vLLM v0.19.0 Released with New Features
vLLM Releaseshigh confidence
Why it matters
- →This release enhances the capabilities of vLLM, making it more versatile for developers working with advanced AI models and architectures.
The vLLM v0.19.0 release includes 448 commits and introduces support for Google Gemma 4 architecture, async scheduling with speculative decoding, and various model enhancements. It also improves compatibility with HuggingFace Transformers v5.
Read originalMore from vLLM Releases
More in Models & Labs
Models & Labsmodels
Llama.cpp b9626 Release Adds Cohere2-MoE Support
The latest b9626 release of llama.cpp introduces architectural support for the cohere2-MoE model, marking a significant update for developers working with this model. This release also includes various technical improvements such as the removal of redundant checks and enhancements in tensor handling, which streamline the model's performance. By adding cohere2moe to the Llama Model Saver supported list, the update broadens the toolkit available for AI practitioners. While these changes may seem incremental, they collectively enhance the robustness and flexibility of llama.cpp, making it a more versatile tool for AI development.
llama.cpp Releases
Models & Labsmodels
llama.cpp b9627 Release Expands Platform Support
The b9627 release of llama.cpp continues to enhance its platform reach, though it doesn't introduce any groundbreaking features. This update includes support for a wide array of systems, from macOS and iOS to various Linux distributions and Windows configurations, including CUDA and Vulkan support. Notably, the release maintains its focus on making llama.cpp a versatile tool across different hardware setups, but it doesn't introduce new model architectures or quantization methods. This iteration is more about solidifying its presence across multiple operating systems rather than introducing novel capabilities.
llama.cpp Releases
Models & Labsmodels
llama.cpp b9628 Release Expands Platform Support
The latest b9628 release of llama.cpp continues its trend of broadening platform compatibility, now including Vulkan support for Ubuntu and Windows, as well as ROCm 7.2 for Ubuntu. This update ensures that developers working across diverse hardware configurations can leverage llama.cpp's capabilities more effectively. While the release doesn't introduce new model architectures, it solidifies llama.cpp's position as a versatile inference runtime. By expanding support across multiple operating systems and hardware, llama.cpp is making it easier for developers to deploy AI models in varied environments.
llama.cpp Releases