Models & Labs
llama.cpp adds MiniMax model support
llama.cpp Releaseshigh confidence
Why it matters
- →Enhances llama.cpp's capabilities with new model support.
- →Optimizes token sampling by addressing zero-valued embeddings.
- →Improves efficiency and robustness for developers using MiniMax models.
The b10437 release of llama.cpp brings support for the MiniMax-Text-01 and MiniMaxM1ForCausalLM models, focusing on optimizing the MiniMax-Text-01 model. Key improvements include the removal of state transpose operations and the introduction of a logits mask to manage zero-valued embeddings, which enhances the token sampling process. These updates aim to improve the efficiency and robustness of llama.cpp for developers using these models. The release does not introduce new model architectures but refines existing functionalities.
Read originalThe story around this
Earlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.
How we got here
- 1llama.cpp adds MiniCPM5 tokenizer support
llama.cpp Releases · May 27, 2026 · Same story
- 2llama.cpp adds support for Gemma4ForCausalLM
llama.cpp Releases · May 27, 2026 · Same story
More from llama.cpp Releases
Coding Toolscoding
llama.cpp b12398 optimizes Vulkan Flash Attention for AMD
This release targets the persistent performance gap on AMD hardware by optimizing Vulkan Flash Attention specifically for RDNA3 and RDNA4 architectures. The changes include reducing shared memory usage through buffer reuse and fixing critical stability issues like NVIDIA hangs and sparse FA underflow bugs. While there are no new model architectures, these low-level shader optimizations directly translate to faster inference speeds for local users on modern AMD GPUs. It is a quiet but necessary engineering update that tightens the ecosystem for non-NVIDIA accelerators.
llama.cpp Releases
Coding Toolscoding
llama.cpp b12399 adds ROCm 10 and CUDA 13 builds
This release quietly extends llama.cpp’s hardware support to the latest NVIDIA and AMD stacks. By shipping binaries for CUDA 13.5 and ROCm 10.0, it ensures users on cutting-edge GPUs don't have to compile from source to get performance gains. The Vulkan build also fixes header inclusion issues that previously broke compilation on some Linux distributions. It’s a maintenance update rather than a feature leap, but it keeps the local inference runtime compatible with the fastest consumer and datacenter hardware available today.
More in Models & Labs
© GitHub ChangelogModels & Labscoding
Gemini 4 Hydrogen arrives in GitHub Copilot
Google’s latest Flash model is now generally available in GitHub Copilot, targeting agentic coding and multistep workflows. It offers improved instruction following over Gemini 3.8 Flash and is billed at provider list pricing under usage-based billing. The rollout is gradual across Visual Studio Code, JetBrains IDEs, and other platforms. Administrators can manage access through model policies in Copilot settings.
GitHub Changelog
© TechCrunch AIModels & Labs
