16 × AIAI signal, amplified
AI newsTopicsAboutSources
TelegramFollow on Telegram
AI newsTopicsAboutSources
16 × AIAI signal, amplified

An AI news engine that ingests trusted sources, scores with Claude, and posts only what clears the bar.

Follow on Telegram →

Subscribe

  • Telegram
  • RSS
  • All channels

Newsletter

Used only to send this newsletter. Privacy

Legal

  • Privacy
  • Imprint
© 2026 16 × AI. All rights reserved.A new issue every two days.
Home/Coding Tools
Coding Tools

llama.cpp b12064 optimizes Hexagon NPU permutes

llama.cpp Releases·November 3, 2026·high confidence

Why it matters

  • →Fixes severe performance bottlenecks on Qualcomm Snapdragon NPUs during tensor reshaping.
  • →Enables efficient channel-first to channel-last permutations for video VAEs and similar models.
  • →Expands support for CUDA 13 and ROCm 10.0 in the latest binary builds.

llama.cpp version b12064 introduces optimized Hexagon vector permute operations for Qualcomm Snapdragon NPUs. The update replaces inefficient DMA descriptors with tiled HVX transpose kernels, significantly improving throughput for channel-first to channel-last data permutations. This change specifically targets performance bottlenecks in video VAEs and similar workloads that require frequent tensor reshaping. The release also includes standard platform binaries for CUDA 13, ROCm 10.0, and various CPU architectures.

Read original

The story around this

Earlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.

llama.cpp b11338 optimizes Hexagon NPU and fixes DMA — llama.cpp Releases1llama.cpp b11680 Hexagon NPU and CUDA 13 support — llama.cpp Releases2llama.cpp b12064 optimizes Hexagon NPU permutesOct 2You are here

How we got here

  1. 1
    llama.cpp b11338 optimizes Hexagon NPU and fixes DMA

    llama.cpp Releases · October 2, 2026 · Same story

  2. 2
    llama.cpp b11680 Hexagon NPU and CUDA 13 support

    llama.cpp Releases · October 16, 2026 · Same story

More from llama.cpp Releases

Coding Toolscoding

llama.cpp b12053 updates Apple memory and adds ROCm 10

This release quietly fixes a memory allocation quirk on Apple Silicon by switching to vm_allocate, which should stabilize buffer handling across macOS and iOS. More notably, it brings ROCm 10.0 support to both Linux and Windows, finally giving AMD GPU users parity with CUDA builds in the standard distribution. The update also extends CUDA 13 compatibility to ARM64 architectures, broadening the hardware base for high-performance inference. It’s a maintenance-heavy release that solidifies llama.cpp as a cross-platform runtime rather than just a local Mac tool.

llama.cpp Releases·Nov 3, 2026
Models & Labsother

llama.cpp b12054 adds CUDA 13 and ROCm 10.0

This release quietly cements llama.cpp as the universal inference runtime by adding default support for CUDA 13 and ROCm 10.0. NVIDIA users can now leverage newer driver stacks without waiting for separate builds, while AMD GPU owners finally get parity with modern ROCm versions. The inclusion of Snapdragon and OpenVINO binaries further widens the hardware net, though Apple Silicon KleidiAI is notably disabled here. It’s less about new features and more about ensuring no major accelerator is left behind in the local LLM ecosystem.

llama.cpp Releases·Nov 3, 2026
Coding Toolscoding

llama.cpp b12057 adds ROCm 10 and Snapdragon support

This release quietly cements llama.cpp as the universal inference runtime by finally bringing first-class ROCm 10.0 support to both Linux and Windows. AMD GPU users no longer need workarounds, effectively closing a long-standing parity gap with NVIDIA's CUDA ecosystem. Equally notable is the new Snapdragon build for Linux, which unlocks local AI on ARM-based laptops using Adreno GPUs and Hexagon NPUs. While KleidiAI on Apple Silicon is temporarily disabled, the expansion into AMD and Qualcomm hardware signals a strategic shift toward broadening accessible local inference beyond just NVIDIA.

llama.cpp Releases·Nov 3, 2026

More in Coding Tools

Coding Toolscoding

Claude Code v2.1.317 patches security and stability

This release prioritizes trust and reliability over new features, addressing critical friction points for enterprise users. The most significant addition is a safety check that prompts before sending account emails to external networks, directly tackling data leakage concerns in automated workflows. For developers managing scale, the new gateway admin API cost report provides granular visibility into spend per developer and IdP group, solving a major blind spot in self-hosted deployments. Stability fixes for session persistence, proxy timeouts, and credential handling ensure that long-running agent tasks don't silently fail or leak data.

Claude Code Releases·Nov 3, 2026
Hugging Face introduces Model Integration Contracts© Hugging Face Blog
Coding Toolscoding

Hugging Face introduces Model Integration Contracts

Hugging Face is solving the regression problem in its massive Transformers library by introducing Model Integration Contracts (MICs). Instead of relying on slow full-scale GPU tests, they shrink real checkpoints into tiny CPU-friendly fixtures that preserve architectural quirks. This approach caught a two-month-old bug in T5’s attention mechanism that standard forward passes missed entirely. It shifts testing from brute-force coverage to precise, reproducible contract verification for every model architecture.

Hugging Face Blog·Nov 3, 2026
Anthropic blocks Claude Code from cloning existing games© The Verge AI
Coding Toolscoding

Anthropic blocks Claude Code from cloning existing games

Anthropic has tightened Claude Code’s system prompt to explicitly forbid recreating specific existing video games, targeting the surge in AI-generated decompilations and ports. The update on Opus 5.5 draws a hard line against IP infringement while preserving the ability to build original titles or genre-inspired projects from scratch. This marks a significant shift in how coding assistants handle intellectual property boundaries, moving from passive compliance to active prevention of direct clones. Developers can now expect stricter refusals when attempting to replicate protected game mechanics or assets.

The Verge AI·Nov 2, 2026