Models & Labs

llama.cpp b9726 Release Adds New Features

llama.cpp ReleasesJune 20, 2026high confidence

Why it matters

→The addition of the --agent argument simplifies server operations for developers.
→Removing redundant web UI naming compatibility streamlines the codebase.
→Enhanced platform support broadens accessibility for diverse development environments.

The b9726 release of llama.cpp brings several updates, including the addition of a --agent argument for the server, which simplifies command-line operations. This release also removes redundant web UI naming compatibility, aiming to streamline the codebase. It supports a wide range of platforms, including macOS, Linux, Windows, and openEuler, with enhancements for both AMD and NVIDIA GPUs. While no new models are introduced, the update focuses on improving platform versatility and developer accessibility.

Read original

More from llama.cpp Releases

Open Sourcecoding

llama.cpp b9724 Release with Bug Fixes

The b9724 release of llama.cpp is all about enhancing stability through a series of bug fixes, including improvements to build processes and overflow prevention in the area() function. This update ensures smoother operations across macOS, Windows, and Ubuntu, with specific support for Vulkan and ROCm 7.2 on Ubuntu. While it doesn't introduce groundbreaking features, the release strengthens llama.cpp's reliability as a tool for developers working in diverse environments. By refining and optimizing the platform, this update makes llama.cpp a more robust choice for AI development, ensuring compatibility with CUDA 12 and 13 on Windows and KleidiAI on Apple Silicon.

llama.cpp ReleasesJun 20, 2026

Open Sourcemodels

llama.cpp b9728 Release Expands Platform Support

The latest b9728 release of llama.cpp continues its trend of broadening platform compatibility, though with some notable exceptions. While macOS Apple Silicon support is present, the KleidiAI feature is disabled, indicating a focus on stability over new features. The release also includes support for a variety of Linux distributions, including Ubuntu with ROCm 7.2 and Vulkan, as well as Windows with CUDA 12 and 13. This update highlights llama.cpp's commitment to being a versatile inference runtime across diverse hardware, though it remains conservative in introducing new capabilities.

llama.cpp ReleasesJun 20, 2026

Models & Labsmodels

llama.cpp b9731 Release Optimizes Token Sorting

The b9731 release of llama.cpp delivers a crucial optimization in how token probabilities are calculated. By adopting std::partial_sort, the system now efficiently sorts only the top-n tokens, cutting operation time from 8555.6 microseconds to 704.3 microseconds per operation. This enhancement is implemented across macOS, Linux, and Windows, improving performance for developers working with large language models. The update doesn't introduce new features but focuses on refining existing capabilities, such as KleidiAI on Apple Silicon and ROCm 7.2 on Ubuntu. This release underscores llama.cpp's commitment to making its core functionalities more efficient, particularly for those leveraging CUDA 12 and 13 on Windows.

llama.cpp ReleasesJun 20, 2026