Models & Labs
llama.cpp b10996 adds CUDA 13 and ROCm 10.0 builds
llama.cpp Releaseshigh confidence
Why it matters
- →CUDA 13 support allows users on newer NVIDIA drivers to run local models without compatibility workarounds.
- →ROCm 10.0 binaries give AMD GPU users parity with NVIDIA in terms of official release availability.
- →openEuler Ascend support expands viable hardware options for inference in specific enterprise or Chinese markets.
llama.cpp has released version b10996, expanding hardware compatibility with new builds for CUDA 13 and ROCm 10.0 on Linux and Windows. The update also adds support for openEuler on Huawei Ascend 910b chips via ACL Graph, while explicitly disabling KleidiAI optimizations for macOS Apple Silicon in this build. Existing binaries for CUDA 12, Vulkan, OpenVINO, and SYCL remain available alongside the new additions. This release primarily serves to keep the inference runtime aligned with the latest driver and library versions for NVIDIA and AMD GPUs.
Read originalThe story around this
Earlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.
What happened next
- 1llama.cpp b11022 adds CUDA 13 and ROCm 10 support
llama.cpp Releases · September 18, 2026 · Same story
- 2llama.cpp b11094 adds CUDA 13 and ROCm 10 builds
llama.cpp Releases · September 22, 2026 · Same story
More from llama.cpp Releases
Coding Toolscoding
llama.cpp b12053 updates Apple memory and adds ROCm 10
This release quietly fixes a memory allocation quirk on Apple Silicon by switching to vm_allocate, which should stabilize buffer handling across macOS and iOS. More notably, it brings ROCm 10.0 support to both Linux and Windows, finally giving AMD GPU users parity with CUDA builds in the standard distribution. The update also extends CUDA 13 compatibility to ARM64 architectures, broadening the hardware base for high-performance inference. It’s a maintenance-heavy release that solidifies llama.cpp as a cross-platform runtime rather than just a local Mac tool.
llama.cpp Releases
Models & Labsother
llama.cpp b12054 adds CUDA 13 and ROCm 10.0
This release quietly cements llama.cpp as the universal inference runtime by adding default support for CUDA 13 and ROCm 10.0. NVIDIA users can now leverage newer driver stacks without waiting for separate builds, while AMD GPU owners finally get parity with modern ROCm versions. The inclusion of Snapdragon and OpenVINO binaries further widens the hardware net, though Apple Silicon KleidiAI is notably disabled here. It’s less about new features and more about ensuring no major accelerator is left behind in the local LLM ecosystem.
llama.cpp Releases
Coding Toolscoding
llama.cpp b12057 adds ROCm 10 and Snapdragon support
This release quietly cements llama.cpp as the universal inference runtime by finally bringing first-class ROCm 10.0 support to both Linux and Windows. AMD GPU users no longer need workarounds, effectively closing a long-standing parity gap with NVIDIA's CUDA ecosystem. Equally notable is the new Snapdragon build for Linux, which unlocks local AI on ARM-based laptops using Adreno GPUs and Hexagon NPUs. While KleidiAI on Apple Silicon is temporarily disabled, the expansion into AMD and Qualcomm hardware signals a strategic shift toward broadening accessible local inference beyond just NVIDIA.
llama.cpp Releases
More in Models & Labs
Models & Labscoding
vLLM v0.33.0: Blackwell & DeepSeek V4.1 Optimizations
vLLM v0.33.0 is a massive infrastructure update that finally brings first-class support for NVIDIA's Blackwell architecture and the new DeepSeek V4.1 models. The release drops CUDA 12.9 in favor of CUDA 13.0, signaling a hard pivot to next-gen hardware while adding critical optimizations like block-diffusion drafters and quantized LM heads that significantly boost decode throughput. AMD users also get major wins with ROCm 10.0 defaults and MonoKernel decoding on MI355X. This isn't just another version bump; it's the runtime catching up to the bleeding edge of model complexity and silicon capability.
vLLM Releases
© TechCrunch AIModels & Labsother
Apple Watch Audio Intelligence Beta Begins
Apple is finally testing the AI features that define its wearable strategy. Live Rewind and Siri Recaps turn the Apple Watch into a passive conversation recorder, using on-device detection to buffer audio before sending it to Private Cloud Compute for summarization. The privacy architecture is aggressive: raw audio never leaves the secure enclave, and summaries are ephemeral by default. This marks the first time ambient AI recording has moved from prototype to consumer beta on a mainstream device.
TechCrunch AI
© AI ExplainedModels & Labsmodels
OpenAI Addresses Safety Issues Ahead of Next Flagship
Reports indicate OpenAI is scrambling to fix safety issues in its training environment before shipping its next flagship model.
AI Explained