llama.cpp has released build b11184, featuring optimized Metal kernels for Apple Silicon devices. The update extends Fast Walsh-Hadamard Transform (FWHT) support to block widths between 1024 and 8192, utilizing threadgroup memory to overcome previous register limitations. Additionally, the release includes binaries for CUDA 13.4 and ROCm 10.0, ensuring compatibility with recent GPU driver updates. The project also maintains builds for OpenVINO, SYCL, and various CPU architectures across macOS, Linux, Windows, and Android.
Read originalThis release quietly refactors how llama.cpp handles Flash Attention on Apple Silicon by splitting kernels into per-dtype libraries. It’s a structural optimization that likely reduces memory overhead and improves compilation times for Metal users, though the immediate performance gains are subtle compared to algorithmic leaps. The build matrix remains massive, adding ROCm 10.0 and CUDA 13.4 support while disabling KleidiAI on Apple Silicon for now. This is infrastructure maintenance rather than a feature breakthrough, but it keeps the runtime robust across the expanding landscape of hardware backends.
One of llama.cpp's quietest but biggest releases. With ROCm 10.0 added as a default build, AMD GPU users stop being second-class citizens for local inference — the gap with CUDA narrows visibly. Apple Silicon Macs now compile in KleidiAI by default, meaning every M-series machine gets ARM-tuned GEMM kernels for free, no flag-flipping required. There's no new model and no new quantization here — just llama.cpp quietly becoming the inference runtime for everyone who isn't on NVIDIA. That's the headline.
A subtle but critical fix in llama.cpp’s mtmd module corrects the mel preprocessor for the LFM2 audio model, eliminating transcription errors that affected over half of tested Japanese utterances. By switching to a symmetric Hann window and adjusting normalization epsilon, the build now matches reference implementations with near-zero error rates instead of changing entire words. This resolves a significant reliability gap for local multilingual speech-to-text, ensuring that open-source inference produces results comparable to proprietary baselines without manual intervention.
This release stabilizes Claude Code by fixing a cascade of session-breaking errors that previously caused silent data loss or API drops. The most significant fix addresses resumed conversations re-sending messages in altered forms, which was corrupting reasoning traces and breaking extended thinking workflows. It also resolves persistent login refresh loops and managed setting parsing failures that plagued enterprise deployments. While the changelog is dense with UI tweaks like scrollbar fixes and vim mode corrections, the core value lies in restoring reliability for long-running agent sessions.
This release quietly solves a major pain point for enterprise AI workflows by adding gateway hint headers, allowing LLM gateways to correctly group requests per user prompt instead of treating them as isolated events. The new managed settings for availableModelsMatch and deniedModels give organizations precise control over model access, blocking specific versions even when broader allowances exist. Beyond governance, the update stabilizes the plugin ecosystem with rigorous validation checks that prevent silent failures from broken or misconfigured extensions. These changes shift Claude Code from a developer tool to a manageable enterprise component.
© Matt WolfeOpenAI launches GPT-Live 1 and a new Agent API, enabling real-time voice interactions and autonomous agent development.