llama.cpp has released version b11564, focusing on Vulkan backend optimizations and expanded hardware support. The primary technical change involves specializing the quantization block size for CM2 matmul operations to avoid switch lowering, improving compilation efficiency and runtime performance. The release adds ROCm 10.0 builds and CUDA 13.4 libraries for both Linux and Windows platforms. Additionally, it includes updates for OpenVINO, SYCL, and various CPU architectures including ARM64 and s390x. KleidiAI support on macOS Apple Silicon is currently disabled in this build.
Read originalEarlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.
llama.cpp Releases · July 19, 2026 · Same story
llama.cpp Releases · September 11, 2026 · Same story
This release quietly cements llama.cpp as the universal inference runtime by finally bringing first-class ROCm 10.0 support to both Linux and Windows. AMD GPU users no longer need workarounds, effectively closing a long-standing parity gap with NVIDIA's CUDA ecosystem. The inclusion of Snapdragon AI stack binaries for Linux marks a significant expansion into mobile-edge hardware, while the addition of CUDA 13 builds future-proofs the tool against upcoming driver requirements. By standardizing these complex backend integrations into single downloadable binaries, the project removes friction for anyone deploying local models on non-NVIDIA silicon.
Prism's Bonsai 2 27B model is now natively supported in llama.cpp, bringing a high-efficiency architecture to the local inference ecosystem. The release includes specific runtime optimizations for its Hadamard transformations, ensuring smooth execution across diverse hardware backends like CUDA and ROCm. This integration allows developers to run a specialized 27B parameter model without custom conversion scripts or external wrappers. It expands the practical toolkit for those needing compact yet capable models on consumer-grade GPUs.
This release refactors llama.cpp’s RPC backend logging, turning a binary debug flag into a granular verbosity system. Developers can now trace tensor transfers and graph cache evictions with precision, which is critical for debugging distributed inference setups. The cleanup also unifies log handling across client and server sides, reducing noise and fixing format specifier bugs. It’s a maintenance win that makes diagnosing remote inference failures significantly easier.
© GitHub ChangelogGitHub Copilot for JetBrains is tightening enterprise grip with managed default models, letting admins lock in specific agents while preserving user choice. The diagnostic workflow gets a direct Fix action that bridges inline chat and agent mode, cutting steps between error detection and resolution. Crucially, new MCP controls let users disable automatic server startup, addressing resource concerns around tool-heavy configurations. This release also drops support for IDE 2025.1, forcing an upgrade to 2025.2 or later.
This release tightens the leash on Claude Code's autonomous capabilities while fixing critical sandbox escapes. The new effort parameter for Agent tools lets developers explicitly control sub-agent depth, a necessary guardrail as these systems grow more complex. Security fixes are prominent, addressing how plugins handle network paths and how file permissions persist during session resumption. It’s a stability patch that ensures the tool remains usable in enterprise environments without compromising on the new agent features.
Anthropic quietly shipped a significant model update alongside routine maintenance. Claude Haiku 5.5 is now the default on the API, offering a 1M context window at $0.10 per million tokens, which lowers the cost floor for high-volume coding tasks. The release also patches critical stability issues in the local agent runtime, specifically fixing memory leaks in HTTP MCP connections and resolving session state corruption during context compaction. These fixes matter because they stabilize the autonomous coding workflow that developers rely on daily. With Haiku 5.5 now standard, teams can deploy cheaper, faster iterations without manual configuration.