Models & Labs
Llama.cpp b10171 Release Fixes Adreno Kernel Bug
llama.cpp Releaseshigh confidence
Why it matters
- →Fixes a critical bug affecting multi-stream batch processing on Adreno devices.
- →Ensures accurate AI task performance on devices without flash attention.
- →Enhances reliability for developers using llama.cpp in high-performance environments.
Llama.cpp has released version b10171, which resolves a critical issue in the Adreno KQ/KQV image kernels. The bug, which ignored certain dimensions in multi-stream batches, led to incorrect outputs on devices such as the Adreno 740. The update reroutes operations to a path that properly handles these dimensions, ensuring accurate processing. This fix is particularly important for developers using llama.cpp on devices without flash attention, as it restores expected performance and reliability.
Read originalMore from llama.cpp Releases
Models & Labsmodels
llama.cpp b10156 Release Expands Platform Support
The latest b10156 release of llama.cpp continues its trend of broadening platform compatibility, notably adding support for ROCm 7.2 on Ubuntu x64. This update ensures that AMD GPU users can leverage llama.cpp more effectively, narrowing the gap with NVIDIA's CUDA. The release also includes Vulkan support for both Ubuntu and Windows, enhancing the versatility of the software for developers. While no new models or quantization methods are introduced, this update solidifies llama.cpp's position as a versatile inference runtime across diverse hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b10158 Release Expands Platform Support
The latest b10158 release of llama.cpp continues its trend of broadening platform compatibility, though without major new features. Notably, the release includes support for ROCm 7.2 on Ubuntu x64, which is significant for AMD GPU users seeking alternatives to NVIDIA's CUDA. While KleidiAI support for Apple Silicon remains disabled, the release still covers a wide array of platforms, including Windows and openEuler. This update demonstrates llama.cpp's commitment to being a versatile inference runtime across diverse hardware configurations.
