Open Source
llama.cpp adds IBM ZDNN backend support
llama.cpp Releaseshigh confidence
Why it matters
- →Enables efficient LLM inference on IBM Z mainframes via ZDNN.
- →Expands llama.cpp's hardware support to s390x architecture.
- →Signals growing enterprise interest in diverse AI infrastructure.
The llama.cpp project has merged a pull request adding continuous integration builds for the IBM ZDNN backend, targeting s390x architecture. Signed off by IBM engineer Aaron Teo, the update includes compiler fixes and CI configuration adjustments to support Ubuntu-based builds on mainframe hardware. Although automated testing is currently disabled, the inclusion of this backend in the official release pipeline marks a significant step toward broader hardware compatibility for local LLM inference beyond standard x86 and ARM platforms.
Read originalMore from llama.cpp Releases
Coding Toolscoding
llama.cpp fixes MoE dispatch inefficiency on Vulkan
This release targets a specific but costly bottleneck in Mixture-of-Experts inference on GPUs. The previous tile selection logic wasted significant compute time by misjudging the active workload per expert during dispatch. By correcting how matmul tiles are assigned, the patch ensures workers stay busy instead of idling. This is a quiet optimization that directly improves throughput for large MoE models running on Vulkan backends.
llama.cpp Releases
Coding Toolscoding
llama.cpp Vulkan perf boost on Intel Arc
Intel's discrete GPUs have long been second-class citizens in local inference due to inefficient memory access patterns. This patch fixes that by batching F32 matrix loads two at a time, squeezing significant throughput out of the B60 architecture. Benchmarks show raw GFLOPS jumping from 153 to 221 on specific shapes, proving that driver-level optimizations matter as much as model architecture. It’s a quiet but necessary fix for anyone running llama.cpp on AMD or Intel hardware.
