Models & Labs
llama.cpp b12124 adds CUDA 13 and Snapdragon support
llama.cpp Releaseshigh confidence
Why it matters
- →CUDA 13 support ensures compatibility with the latest NVIDIA driver stacks and hardware.
- →Snapdragon arm64 build enables efficient local inference on mobile and ARM-based desktops.
- →ROCm 10.0 integration improves AMD GPU performance for open-source AI workloads.
llama.cpp has released version b12124, expanding its binary distribution to support newer and diverse hardware architectures. Key additions include native builds for CUDA 13 (versions 12.8 and 13.4) on Linux and Windows, as well as ROCm 10.0 support for AMD GPUs. Notably, the release introduces a Linux arm64 build optimized for Qualcomm Snapdragon processors, leveraging CPU, Adreno GPU, and Hexagon NPU capabilities. Conversely, macOS Apple Silicon builds with KleidiAI are currently disabled in this version. The update also includes OpenVINO and SYCL enhancements across platforms.
Read originalThe story around this
Earlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.
How we got here
- 1llama.cpp b12032 adds CUDA 13 and Snapdragon support
llama.cpp Releases · November 1, 2026 · Same story
- 2llama.cpp b12058 adds CUDA 13 and Snapdragon support
llama.cpp Releases · November 3, 2026 · Same story
More from llama.cpp Releases
Coding Toolscoding
llama.cpp b12173 adds OpenCL repeat ops
This release quietly patches a gap in llama.cpp's OpenCL backend by adding support for the 'repeat' operation across f16, i32, i16, and bf16 types. For users relying on AMD or Intel GPUs via OpenCL rather than Vulkan or ROCm, this means fewer fallbacks to slower CPU execution for models that use these tensor operations. It’s a targeted fix that improves stability and performance on non-NVIDIA hardware without changing the core inference engine. The update also includes standard binaries for CUDA 13 and ROCm 10.0, keeping the stack current with latest driver ecosystems.
llama.cpp Releases
Coding Toolscoding
llama.cpp b12174 adds ROCm 10 and CUDA 13
This release quietly closes the hardware gap for non-NVIDIA users by adding default support for ROCm 10.0 on both Linux and Windows, allowing AMD GPU owners to run local models without complex configuration. It also brings CUDA 13.5 builds to Ubuntu and Windows, future-proofing the toolchain for newer NVIDIA architectures while maintaining backward compatibility with CUDA 12. Apple Silicon KleidiAI is disabled in this build, a notable regression for Mac users who rely on that specific optimization. The update solidifies llama.cpp's position as the most versatile inference runtime available, covering everything from Snapdragon NPUs to Intel Arc via SYCL.
llama.cpp Releases
Coding Toolscoding
llama.cpp b12175 fixes CI hangs, adds ROCm 10 and CUDA 13
This release stabilizes the build pipeline by fixing a threading bug that caused test hangs on self-hosted runners, ensuring more reliable binaries for everyone. More importantly, it brings first-class support for ROCm 10.0 and CUDA 13 across Linux and Windows, closing the gap with NVIDIA's latest driver stacks. AMD users finally get parity with CUDA builds without manual configuration tweaks. The update also expands Apple Silicon coverage to include KleidiAI, though it remains disabled by default in this build. It’s a maintenance-heavy release that quietly modernizes the backend support matrix.
llama.cpp Releases
More in Models & Labs
© Lev SelectorModels & Labsmodels
GPT-6 Astra Edits Qwen Weights Directly
OpenAI's GPT-6 model demonstrated the ability to directly edit the weights of Qwen models, marking a significant step in AI self-improvement and model manipulation.
Lev Selector
© Lev SelectorModels & Labsmodels
Google Runs Gemma 4 in Orbit
Google successfully deployed its Gemma 4 model on satellites in orbit, testing AI inference capabilities in space environments.
Lev Selector
© Matt WolfeModels & Labsvideo
Google Launches Gemini Omni 1.2 Flash and Free Video Gen
Google released Gemini Omni 1.2 Flash and integrated free AI video generation into Google Vids for users.
Matt Wolfe