16 × AIAI signal, amplified
AI newsAboutSources
TelegramFollow on Telegram
AI newsAboutSources
16 × AIAI signal, amplified

An AI news engine that ingests trusted sources, scores with Claude, and posts only what clears the bar.

Follow on Telegram →

Subscribe

  • Telegram
  • RSS
  • All channels

Legal

  • Privacy
  • Imprint
© 2026 16 × AI. All rights reserved.Curated by Claude. Posts every 6 hours. No newsletter, no funnel.
Home/Coding Tools
Coding Tools

llama.cpp b11140 optimizes sparse attention on CUDA

llama.cpp Releases·September 24, 2026·high confidence

Why it matters

  • →Sparse attention optimization significantly reduces latency for long-context inference on NVIDIA GPUs.
  • →Kernel unrolling at compile time eliminates runtime overhead in the query loop.
  • →Improvements are included in standard CUDA builds, requiring no user configuration changes.

llama.cpp b11140 delivers targeted performance improvements for NVIDIA GPU inference, specifically optimizing the sparse flash attention prefill step. By templating kernels to unroll loops at compile time, batched sparse operations on 49k context windows drop from 586 microseconds to 244 microseconds. The release also includes standard platform binaries for CUDA 12/13, ROCm 10.0, and various CPU architectures, with KleidiAI builds disabled on macOS as per previous stability decisions.

Read original

More from llama.cpp Releases

Coding Toolscoding

llama.cpp b11146 adds CUDA 13 and Snapdragon support

The latest llama.cpp build brings immediate relevance to users on bleeding-edge NVIDIA hardware with native CUDA 13.4 support across Linux and Windows, closing the gap for those testing next-gen GPU architectures. More notably, it finally addresses the mobile inference landscape by including a dedicated build for Linux arm64 Snapdragon devices, covering CPU, Adreno GPU, and Hexagon NPU paths. This moves local AI beyond just desktop GPUs into the realm of high-performance edge computing on Qualcomm silicon. While Apple Silicon builds have KleidiAI disabled in this specific release, the expansion to ARM-based mobile NPUs marks a significant shift in where llama.cpp can run efficiently.

llama.cpp Releases·Sep 24, 2026
Coding Toolscoding

llama.cpp b11147 adds ROCm 10 and Snapdragon support

This release quietly cements llama.cpp as the universal inference runtime by finally bringing first-class ROCm 10.0 support to both Linux and Windows. AMD GPU users no longer need workarounds, effectively closing a long-standing parity gap with NVIDIA's CUDA ecosystem. Equally notable is the new Linux arm64 build targeting Snapdragon chips, which unlocks local LLM execution on high-performance mobile hardware via CPU, Adreno GPU, and Hexagon NPU acceleration. While KleidiAI on Apple Silicon has been disabled in this specific binary set, the broader platform expansion signals a shift toward heterogeneous computing that extends well beyond traditional desktop GPUs.

llama.cpp Releases·Sep 24, 2026
Models & Labsother

llama.cpp b11149 adds backend testing and ROCm 10 support

This release quietly solidifies llama.cpp’s position as the universal inference runtime by adding explicit ROCm 10.0 builds for both Linux and Windows. The inclusion of CUDA 13.4 alongside the existing 12.x variants ensures compatibility with the latest NVIDIA driver stacks without forcing users to stick to older libraries. More importantly, the new backend testing infrastructure means these diverse hardware configurations are now validated systematically rather than left to chance. This reduces fragmentation for developers running on AMD or newer NVIDIA cards who previously had to troubleshoot build issues manually.

llama.cpp Releases·Sep 24, 2026

More in Coding Tools

Coding Toolscoding

Claude Code v2.1.281 fixes session stability and adds Bedrock guardrails

This release stabilizes Claude Code's core reliability by fixing persistent bugs in session resumption and prompt caching that previously caused data loss or infinite loops. It also tightens enterprise security with new Bedrock upstream support for IAM role assumption and mandatory guardrail application. The update addresses critical edge cases like proxy stream drops and oversized tool calls, ensuring smoother operation in complex development environments.

Claude Code Releases·Sep 24, 2026
Anthropic releases official Claude Code playbook for Opus 5.5© Duncan Rogoff
Coding Toolscoding

Anthropic releases official Claude Code playbook for Opus 5.5

Anthropic has published an official guide on optimizing Claude Code with the new Opus 5.5 model, shifting focus from raw capability to engineered workflow. The playbook details specific prompting habits that reduce latency and cost while increasing autonomy during long coding sessions. This moves beyond generic advice, offering concrete strategies for developers who rely on agentic coding tools for complex tasks. It signals a maturation in how enterprise-grade AI assistants are integrated into daily engineering practices.

Duncan Rogoff·Sep 23, 2026
GitHub Actions drops Node 20, mandates Node 24© GitHub Changelog
Coding Toolscoding

GitHub Actions drops Node 20, mandates Node 24

GitHub has permanently removed Node 20 from its hosted runners, forcing all JavaScript actions to run on Node 24. The safety net of the unsecure node opt-out is gone, meaning workflows relying on older action versions will break immediately. This shift eliminates legacy runtime support and introduces compatibility constraints for macOS 13.4 and ARM32 architectures. Maintainers must update their action metadata now, while workflow users need to upgrade dependencies to avoid CI failures.

GitHub Changelog·Sep 23, 2026