Models & Labs
Kimi-K3 Text Model Added to llama.cpp
llama.cpp Releaseshigh confidence
Why it matters
- →The Kimi-K3 model introduces advanced features that enhance text generation capabilities.
- →Developers gain access to more sophisticated tools for deploying AI models.
- →This update reflects ongoing innovation in AI model architecture.
The llama.cpp project has released a new update featuring the Kimi-K3 text model. This model enhances the existing Kimi-Linear-48B architecture with new features such as cross-layer residual attention and a situ activation function. Additionally, it includes a full-rank KDA gate and an MLA output gate, which are designed to improve model performance. These advancements provide developers with more robust tools for text generation, marking a notable progression in AI model capabilities.
Read originalThe story around this
Earlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.
How we got here
- 1llama.cpp b9850 Release Enhances Qwen3 Model
llama.cpp Releases · July 2, 2026 · Same story
What happened next
- 2llama.cpp adds Kimi K3.1-Pro support
llama.cpp Releases · November 7, 2026 · Same story
Follow this story
Open the full story →Kimi-K3 Text Model Added to llama.cpp
3 developments
- Aug 16 · llama.cpp Releases
Kimi-K3 Text Model Added to llama.cpp (This article) - Aug 16 · llama.cpp Releases
llama.cpp adds MiniMax model support↳ llama.cpp integrates MiniMax-Text-01 and MiniMaxM1ForCausalLM models with optimized token sampling via logits masks. - Aug 26 · llama.cpp Releases
llama.cpp v0.3.0 Release
More from llama.cpp Releases
Coding Toolscoding
llama.cpp b12398 optimizes Vulkan Flash Attention for AMD
This release targets the persistent performance gap on AMD hardware by optimizing Vulkan Flash Attention specifically for RDNA3 and RDNA4 architectures. The changes include reducing shared memory usage through buffer reuse and fixing critical stability issues like NVIDIA hangs and sparse FA underflow bugs. While there are no new model architectures, these low-level shader optimizations directly translate to faster inference speeds for local users on modern AMD GPUs. It is a quiet but necessary engineering update that tightens the ecosystem for non-NVIDIA accelerators.
llama.cpp Releases
Coding Toolscoding
llama.cpp b12399 adds ROCm 10 and CUDA 13 builds
This release quietly extends llama.cpp’s hardware support to the latest NVIDIA and AMD stacks. By shipping binaries for CUDA 13.5 and ROCm 10.0, it ensures users on cutting-edge GPUs don't have to compile from source to get performance gains. The Vulkan build also fixes header inclusion issues that previously broke compilation on some Linux distributions. It’s a maintenance update rather than a feature leap, but it keeps the local inference runtime compatible with the fastest consumer and datacenter hardware available today.
llama.cpp Releases
Coding Toolscoding
llama.cpp b12400 release with CUDA 13 and ROCm 10
This is a routine maintenance release for llama.cpp that quietly extends hardware support to the latest NVIDIA and AMD stacks. By adding CUDA 13.5 and ROCm 10.0 binaries, it ensures local inference remains viable on cutting-edge GPUs without waiting for community forks. The build also includes OpenVINO and SYCL variants, reinforcing its role as the universal runtime for diverse accelerators. While no new model architectures are introduced, this update keeps the toolchain compatible with modern driver ecosystems.
llama.cpp Releases
More in Models & Labs
© GitHub ChangelogModels & Labscoding
Gemini 4 Hydrogen arrives in GitHub Copilot
Google’s latest Flash model is now generally available in GitHub Copilot, targeting agentic coding and multistep workflows. It offers improved instruction following over Gemini 3.8 Flash and is billed at provider list pricing under usage-based billing. The rollout is gradual across Visual Studio Code, JetBrains IDEs, and other platforms. Administrators can manage access through model policies in Copilot settings.
GitHub Changelog
© TechCrunch AIModels & Labsproductivity
ElevenLabs launches ElevenAI for teams
ElevenLabs is moving beyond voice synthesis into the crowded meeting intelligence space with ElevenAI. The app merges transcription, dictation across 90+ languages, and agent-driven follow-ups like drafting emails directly from conversation context. This positions their $22B valuation engine as a central knowledge hub for enterprises, aiming to replace standalone notetakers. It’s a strategic play to lock teams into their ecosystem using the recently launched v3 Scribe models.
TechCrunch AI
© TechCrunch AIModels & Labsmodels
Google deploys Gemini 4 Hydrogen for faster Search
Google is quietly shifting its search infrastructure by replacing older fast models with Gemini 4 Hydrogen, a tier designed specifically for speed and cost-efficiency rather than raw reasoning power. This model completes tasks 2.5 times faster than its predecessor while beating the more powerful Argon on specific intelligence benchmarks, proving that specialized efficiency can outperform brute force in high-volume workflows. By integrating this into Search's fan-out technique, Google now breaks down complex queries into subqueries with greater precision and speed, delivering richer visual responses without the latency of heavier models. This marks a strategic pivot toward agentic execution layers within consumer search, making AI Mode feel snappier for everyday multi-part questions.
TechCrunch AI