Open Source
llama.cpp b9139 Release Expands Platform Support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands platform compatibility, making llama.cpp more versatile.
- →Enhances support for developers using diverse hardware configurations.
- →Strengthens llama.cpp's position as a widely accessible inference runtime.
The b9139 release of llama.cpp introduces expanded platform support, including macOS Apple Silicon with KleidiAI and various Linux distributions with Vulkan and ROCm 7.2. Windows users benefit from added support for CUDA 12 and 13 DLLs, enhancing compatibility across different hardware setups. This update doesn't introduce new features but strengthens llama.cpp's versatility as an inference runtime. Developers can now utilize llama.cpp on a wider range of systems, ensuring broader accessibility and usability.
Read originalMore from llama.cpp Releases
Open Sourcecoding
llama.cpp b9129 Release Enhances CPU Fallback
The b9129 release of llama.cpp introduces an adaptive fallback feature for the ggml-zendnn backend, which optimizes performance by switching to the CPU for small batch sizes. This feature is enabled by default, but developers can control it using a new runtime environment variable, allowing them to revert to the original fallback logic if desired. The update supports platforms like macOS with KleidiAI, Windows with CUDA 12 and 13, and Ubuntu with ROCm 7.2, ensuring efficient processing across different systems. This release highlights llama.cpp's focus on enhancing performance and flexibility for developers working with various hardware configurations.
llama.cpp Releases
Models & Labsmodels
Llama.cpp b9133 Release Enhances Reasoning Models
The latest b9133 release of llama.cpp introduces significant improvements for reasoning models, particularly in server and web UI environments. By removing the blocking assistant prefill and orchestrating thinking tags, the update ensures smoother continuation of generation tasks. This release also drops the reasoning guard on the Continue button, allowing for persistent reasoning content even after reloads. While the update focuses on templates with simple thinking tags, it sets the stage for future enhancements in reasoning model capabilities.
