Models & Labs
Kimi K3: Largest Open-Weight AI Model Released
Together AI Bloghigh confidence
Why it matters
- →Kimi K3 sets a new benchmark as the largest open-weight AI model, expanding possibilities for open-source AI development.
- →Its advanced architecture supports complex tasks, making it a competitive alternative to proprietary models.
- →The model's release enhances accessibility to cutting-edge AI capabilities for developers and researchers.
Moonshot AI has released Kimi K3, a 2.8-trillion-parameter model, making it the largest open-weight AI model to date. Designed for advanced tasks such as long-horizon coding and deep reasoning, Kimi K3 competes with leading proprietary models like GPT 5.6 Sol. It features new architectural innovations, including Kimi Delta Attention and Attention Residuals, which improve its ability to process long sequences and complex tasks. This release represents a significant advancement in open-source AI, providing developers with a powerful new tool for sophisticated AI applications.
Read originalThe story around this
TopicMoonshot AI Kimi K3Cooling
Earlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.
More in Models & Labs
Models & Labsother
llama.cpp b11193 adds Snapdragon Hexagon and ROCm 10
This release quietly expands llama.cpp's hardware support to include Qualcomm's Hexagon NPU on Linux arm64, a significant step for local inference on Snapdragon devices. It also updates CUDA builds to version 13.4 and introduces ROCm 10.0 binaries, keeping the project aligned with the latest NVIDIA and AMD driver ecosystems. KleidiAI on Apple Silicon is temporarily disabled in this build, likely due to stability checks rather than a feature rollback. For developers targeting edge AI or diverse GPU stacks, this update ensures broader compatibility without requiring custom compilation.
llama.cpp Releases
© Lev SelectorModels & Labsmodels
NVIDIA NVFP4 and SoL-Pi Token Efficiency
NVIDIA introduced the NVFP4 4-bit format and SoL-Pi technology, which uses 2x fewer tokens for improved efficiency.