Models & Labs
llama.cpp b12054 adds CUDA 13 and ROCm 10.0
llama.cpp Releaseshigh confidence
Why it matters
- →CUDA 13 support allows users with newer NVIDIA drivers to run local models without compatibility issues.
- →ROCm 10.0 integration improves performance and accessibility for AMD GPU users in the local inference space.
- →Expanded Snapdragon and OpenVINO builds broaden hardware options beyond traditional x86 and NVIDIA setups.
llama.cpp has released build b12054, expanding hardware compatibility for local large language model inference. The update adds support for CUDA 13 (versions 12.4 and 13.4) and ROCm 10.0 across Linux and Windows platforms. Additional builds include OpenVINO, SYCL, and Snapdragon AI engine support. Notably, macOS KleidiAI support is currently disabled in this release. The update reinforces llama.cpp's position as a cross-platform standard for running models on diverse hardware.
Read originalThe story around this
Earlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.
How we got here
- 1llama.cpp b11036 adds CUDA 13 and ROCm 10.0
llama.cpp Releases · September 19, 2026 · Same story
- 2llama.cpp b11424 adds CUDA 13 and ROCm 10.0
llama.cpp Releases · October 6, 2026 · Same story
More from llama.cpp Releases
Coding Toolscoding
llama.cpp b12053 updates Apple memory and adds ROCm 10
This release quietly fixes a memory allocation quirk on Apple Silicon by switching to vm_allocate, which should stabilize buffer handling across macOS and iOS. More notably, it brings ROCm 10.0 support to both Linux and Windows, finally giving AMD GPU users parity with CUDA builds in the standard distribution. The update also extends CUDA 13 compatibility to ARM64 architectures, broadening the hardware base for high-performance inference. It’s a maintenance-heavy release that solidifies llama.cpp as a cross-platform runtime rather than just a local Mac tool.
llama.cpp Releases
Coding Toolscoding
llama.cpp b12057 adds ROCm 10 and Snapdragon support
This release quietly cements llama.cpp as the universal inference runtime by finally bringing first-class ROCm 10.0 support to both Linux and Windows. AMD GPU users no longer need workarounds, effectively closing a long-standing parity gap with NVIDIA's CUDA ecosystem. Equally notable is the new Snapdragon build for Linux, which unlocks local AI on ARM-based laptops using Adreno GPUs and Hexagon NPUs. While KleidiAI on Apple Silicon is temporarily disabled, the expansion into AMD and Qualcomm hardware signals a strategic shift toward broadening accessible local inference beyond just NVIDIA.
llama.cpp Releases
Coding Toolscoding
llama.cpp b12058 adds CUDA 13 and Snapdragon support
This release quietly cements llama.cpp as the universal inference runtime by finally supporting CUDA 13 alongside the established CUDA 12 builds. The inclusion of native Snapdragon Linux binaries marks a significant step toward on-device AI for ARM-based mobile hardware, moving beyond just desktop GPUs. While Apple Silicon KleidiAI is currently disabled in this build, the broader platform coverage ensures that developers aren't locked into NVIDIA ecosystems anymore. It’s less about new features and more about removing friction for anyone running newer drivers or edge devices.
llama.cpp Releases
More in Models & Labs
Models & Labscoding
vLLM v0.33.0: Blackwell & DeepSeek V4.1 Optimizations
vLLM v0.33.0 is a massive infrastructure update that finally brings first-class support for NVIDIA's Blackwell architecture and the new DeepSeek V4.1 models. The release drops CUDA 12.9 in favor of CUDA 13.0, signaling a hard pivot to next-gen hardware while adding critical optimizations like block-diffusion drafters and quantized LM heads that significantly boost decode throughput. AMD users also get major wins with ROCm 10.0 defaults and MonoKernel decoding on MI355X. This isn't just another version bump; it's the runtime catching up to the bleeding edge of model complexity and silicon capability.
vLLM Releases
© TechCrunch AIModels & Labsother
Apple Watch Audio Intelligence Beta Begins
Apple is finally testing the AI features that define its wearable strategy. Live Rewind and Siri Recaps turn the Apple Watch into a passive conversation recorder, using on-device detection to buffer audio before sending it to Private Cloud Compute for summarization. The privacy architecture is aggressive: raw audio never leaves the secure enclave, and summaries are ephemeral by default. This marks the first time ambient AI recording has moved from prototype to consumer beta on a mainstream device.
TechCrunch AI
© AI ExplainedModels & Labsmodels
OpenAI Addresses Safety Issues Ahead of Next Flagship
Reports indicate OpenAI is scrambling to fix safety issues in its training environment before shipping its next flagship model.
AI Explained