Open Source
llama.cpp b9538 Release Expands Platform Support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands support for AMD GPUs, reducing reliance on NVIDIA's CUDA.
- →Enhances versatility with Vulkan support across multiple platforms.
- →Positions llama.cpp as a flexible tool for diverse hardware configurations.
The b9538 release of llama.cpp introduces expanded platform support, including ROCm 7.2 for Ubuntu x64, enhancing compatibility for AMD GPU users. This update also includes Vulkan support across various systems, although some features like KleidiAI on Apple Silicon remain disabled. The release aims to make llama.cpp more versatile for developers working with different hardware setups. By broadening its platform reach, llama.cpp continues to position itself as a flexible tool for AI development.
Read originalMore from llama.cpp Releases
Open Sourcemodels
llama.cpp b9533 release expands platform support
The b9533 release of llama.cpp continues its focus on enhancing platform compatibility, though some features are notably absent. While macOS Apple Silicon users will find KleidiAI support disabled, the release introduces Vulkan support for both Ubuntu and Windows, and keeps CUDA support updated with new DLLs for Windows. The addition of ROCm 7.2 for Ubuntu x64 is particularly important for AMD GPU users, helping to close the gap with NVIDIA's CUDA. This update is more about refining existing capabilities and ensuring that llama.cpp runs smoothly across various environments, rather than unveiling new model architectures.
llama.cpp Releases
Models & Labsmodels
llama.cpp b9534 release enhances Intel Vulkan support
The b9534 release of llama.cpp brings significant improvements for Intel users, notably adding FWHT support in Vulkan with shared memory reduction. This update tackles specific driver issues by disabling features like subgroup shuffle on MoltenVK AMD and the FWHT shader on Intel Windows, ensuring smoother operation. While KleidiAI remains disabled on macOS Apple Silicon, the release continues to refine compatibility with systems such as Ubuntu and Windows. With ROCm 7.2 and CUDA 12 and 13 DLLs included, llama.cpp is steadily optimizing its performance for a variety of hardware setups. These enhancements reflect a focused effort to support diverse computing environments.
