Open Source
llama.cpp b9495 release enhances platform support
llama.cpp Releaseshigh confidence
Why it matters
- →The update improves model performance with post-norm hidden states.
- →Expanding platform support increases accessibility for developers.
- →Renaming conventions indicate structural changes in the framework.
The latest b9495 release of llama.cpp introduces several updates, including the use of post-norm hidden states for the qwen35 model's MTP. The release also renames 'pre_norm' to 'nextn', reflecting a change in the framework's structure. While some features are disabled, such as KleidiAI on macOS Apple Silicon, the update enhances support for platforms like Ubuntu with ROCm 7.2 and Windows with CUDA 12 and 13. These changes aim to improve the framework's adaptability and performance across different environments.
Read originalMore from llama.cpp Releases
Open Sourcemodels
llama.cpp b9489 release enhances CUDA support
The b9489 release of llama.cpp brings notable improvements for CUDA users, specifically by reserving space for quantized key-value caches at startup. This update also addresses previous feedback and removes certain assertions in the ggml-cuda.cu file, enhancing the CUDA experience. While it doesn't introduce new models or quantization techniques, the release continues to refine the platform's compatibility across macOS, Linux, and Windows. With ROCm 7.2 and KleidiAI support, llama.cpp is becoming a more robust tool for developers working with CUDA and other environments. This iteration is a step towards making llama.cpp a more versatile and efficient tool for AI development.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9490 Release Expands Platform Support
The latest b9490 release of llama.cpp continues its trend of broadening platform compatibility, though with some notable exceptions. While macOS Apple Silicon users see KleidiAI support disabled, the release strengthens its Linux offerings with Vulkan and ROCm 7.2 support on Ubuntu. Windows users benefit from CUDA 12 and 13 DLLs, enhancing GPU performance options. Despite some features being disabled, this update demonstrates llama.cpp's commitment to being a versatile inference runtime across diverse systems.
