Open Source
llama.cpp b9140 Release Expands Platform Support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands llama.cpp's usability across diverse hardware platforms.
- →Enhances accessibility for developers working with different systems.
- →Focuses on platform compatibility rather than new model introductions.
The b9140 release of llama.cpp has been announced, expanding its support across multiple platforms. This update includes compatibility with macOS Apple Silicon, Ubuntu with ROCm 7.2, and Windows with CUDA 12 and 13, among others. The release aims to enhance accessibility for developers by supporting a variety of hardware configurations, including Vulkan and SYCL. While no new models are introduced, the focus is on broadening the tool's usability for AI inference tasks.
Read originalMore from llama.cpp Releases
Open Sourcecoding
llama.cpp b9129 Release Enhances CPU Fallback
The b9129 release of llama.cpp introduces an adaptive fallback feature for the ggml-zendnn backend, which optimizes performance by switching to the CPU for small batch sizes. This feature is enabled by default, but developers can control it using a new runtime environment variable, allowing them to revert to the original fallback logic if desired. The update supports platforms like macOS with KleidiAI, Windows with CUDA 12 and 13, and Ubuntu with ROCm 7.2, ensuring efficient processing across different systems. This release highlights llama.cpp's focus on enhancing performance and flexibility for developers working with various hardware configurations.
llama.cpp Releases
Models & Labsmodels
Llama.cpp b9133 Release Enhances Reasoning Models
The latest b9133 release of llama.cpp introduces significant improvements for reasoning models, particularly in server and web UI environments. By removing the blocking assistant prefill and orchestrating thinking tags, the update ensures smoother continuation of generation tasks. This release also drops the reasoning guard on the Continue button, allowing for persistent reasoning content even after reloads. While the update focuses on templates with simple thinking tags, it sets the stage for future enhancements in reasoning model capabilities.
