Open Source
llama.cpp b9494 release expands platform support
llama.cpp Releaseshigh confidence
Why it matters
- →ROCm 7.2 support for Ubuntu x64 enhances AMD GPU compatibility.
- →Vulkan support on multiple platforms broadens graphical processing capabilities.
- →Disabled features indicate ongoing development and potential future updates.
The latest b9494 release of llama.cpp introduces expanded platform support, particularly for Ubuntu and Windows users. Notably, Vulkan support is now available on both Ubuntu and Windows, while ROCm 7.2 support for Ubuntu x64 enhances compatibility for AMD GPUs. However, some features like KleidiAI on macOS Apple Silicon remain disabled, suggesting areas still under development. This release underscores llama.cpp's commitment to broad platform accessibility, though certain limitations persist.
Read originalMore from llama.cpp Releases
Open Sourcemodels
llama.cpp b9489 release enhances CUDA support
The b9489 release of llama.cpp brings notable improvements for CUDA users, specifically by reserving space for quantized key-value caches at startup. This update also addresses previous feedback and removes certain assertions in the ggml-cuda.cu file, enhancing the CUDA experience. While it doesn't introduce new models or quantization techniques, the release continues to refine the platform's compatibility across macOS, Linux, and Windows. With ROCm 7.2 and KleidiAI support, llama.cpp is becoming a more robust tool for developers working with CUDA and other environments. This iteration is a step towards making llama.cpp a more versatile and efficient tool for AI development.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9490 Release Expands Platform Support
The latest b9490 release of llama.cpp continues its trend of broadening platform compatibility, though with some notable exceptions. While macOS Apple Silicon users see KleidiAI support disabled, the release strengthens its Linux offerings with Vulkan and ROCm 7.2 support on Ubuntu. Windows users benefit from CUDA 12 and 13 DLLs, enhancing GPU performance options. Despite some features being disabled, this update demonstrates llama.cpp's commitment to being a versatile inference runtime across diverse systems.
