Models & Labs
Moonshot releases Kimi K3 with 2.8 trillion parameters
Fireshipmedium confidence
Why it matters
- →Kimi K3's 2.8 trillion parameters represent a new scale in AI model size.
- →The model's open-weight nature could foster innovation and experimentation.
- →Its performance will influence future AI development and applications.
Moonshot has launched Kimi K3, an AI model with a staggering 2.8 trillion parameters, setting a new benchmark in the scale of open-weight AI models. This release could significantly enhance the model's ability to process complex data, although its practical performance remains to be seen. The introduction of Kimi K3 highlights the ongoing trend of increasing AI model sizes, which may lead to more sophisticated AI applications. The effectiveness of Kimi K3 will ultimately depend on its real-world application and performance.
Read originalThe story around this
Earlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.
More from Fireship
More in Models & Labs
Models & Labsother
llama.cpp b11193 adds Snapdragon Hexagon and ROCm 10
This release quietly expands llama.cpp's hardware support to include Qualcomm's Hexagon NPU on Linux arm64, a significant step for local inference on Snapdragon devices. It also updates CUDA builds to version 13.4 and introduces ROCm 10.0 binaries, keeping the project aligned with the latest NVIDIA and AMD driver ecosystems. KleidiAI on Apple Silicon is temporarily disabled in this build, likely due to stability checks rather than a feature rollback. For developers targeting edge AI or diverse GPU stacks, this update ensures broader compatibility without requiring custom compilation.
llama.cpp Releases
© Lev SelectorModels & Labsmodels
NVIDIA NVFP4 and SoL-Pi Token Efficiency
NVIDIA introduced the NVFP4 4-bit format and SoL-Pi technology, which uses 2x fewer tokens for improved efficiency.