llama.cpp has released build b11268, expanding hardware support to include ROCm 10.0 for AMD GPUs on Linux and Windows, as well as native Snapdragon support for Linux devices. The update also provides CUDA 13 builds (13.4 libraries) alongside existing CUDA 12 options across multiple operating systems. Additionally, OpenVINO and SYCL backends are available for Intel hardware, while macOS KleidiAI builds have been temporarily disabled in this release. This update significantly broadens the range of consumer and enterprise hardware capable of running local LLMs efficiently.
Read originalThis release targets a specific but costly bottleneck in Mixture-of-Experts inference on GPUs. The previous tile selection logic wasted significant compute time by misjudging the active workload per expert during dispatch. By correcting how matmul tiles are assigned, the patch ensures workers stay busy instead of idling. This is a quiet optimization that directly improves throughput for large MoE models running on Vulkan backends.
Intel's discrete GPUs have long been second-class citizens in local inference due to inefficient memory access patterns. This patch fixes that by batching F32 matrix loads two at a time, squeezing significant throughput out of the B60 architecture. Benchmarks show raw GFLOPS jumping from 153 to 221 on specific shapes, proving that driver-level optimizations matter as much as model architecture. It’s a quiet but necessary fix for anyone running llama.cpp on AMD or Intel hardware.
Anthropic quietly upgrades its local coding agent with Sonnet 5.5 as the new default, bringing a massive 1M context window to developers' terminals. This isn't just a model swap; it fundamentally changes how much codebase history you can keep in memory without manual chunking. The release also patches critical stability issues like malformed image crashes and broken MCP reconnections, making the tool significantly more reliable for complex workflows. For builders, this means deeper context awareness and fewer interruptions during long coding sessions.
This release prioritizes security hygiene and session reliability over new features. The addition of CLAUDE_CODE_DISABLE_WEB_FETCH is a critical control for enterprise environments needing to restrict external data access. Bug fixes address subtle race conditions in cloud sessions and artifact publishing that could lead to data loss or incorrect state. SSH and plugin installation issues are resolved, ensuring smoother remote workflows. It’s a maintenance update that tightens the tool's operational boundaries.