Open Source
vLLM Releases v0.18.2rc0 Update
vLLM Releasesmedium confidence
Why it matters
- →This update addresses a specific issue that could affect image processing tasks, which is relevant for developers using the PaddleOCR-VL framework.
The v0.18.2rc0 release includes a fix for handling the max_pixels parameter in the PaddleOCR-VL image processor across transformations.
Read originalMore from vLLM Releases
Models & Labsother
v0.19.0rc0 Release with CPU KV Cache Offloading
The v0.19.0rc0 release introduces a feature for CPU key-value cache offloading, enhancing performance. This update was signed off by Yifan Qiao.
vLLM Releases
Models & Labsother
v0.19.0rc1 Release Announcement
More in Open Source
Open Sourceother
New Vulkan Functions Added in Llama.cpp Release
The latest release of Llama.cpp introduces new Vulkan functions for tensor manipulation and updates across multiple platforms.
llama.cpp Releases
Open Sourceother
New Release of llama.cpp Supports Multiple Platforms
The latest release of llama.cpp includes support for various operating systems and architectures, including macOS, Linux, Android, and Windows. This update enhances compatibility for developers working across different environments.