Models & Labs
Moonshot AI's Kimi K3 Model Bets on Memory
AI Newshigh confidence
Why it matters
- →Kimi K3 is the largest open-weight model, setting a new benchmark in AI model size.
- →The model's focus on memory efficiency over compute power addresses China's hardware constraints.
- →It offers a viable option for enterprises seeking data sovereignty and regional language support.
Moonshot AI has launched the Kimi K3, the largest open-weight AI model with 2.8 trillion parameters. The model emphasizes memory efficiency over compute power, using techniques like mixture-of-experts and quantization-aware training to reduce memory demands. This design choice is strategic, given China's limitations on high-performance computing resources. While K3 requires significant infrastructure to deploy, it offers Asian enterprises a robust option for data sovereignty and regional language support. The model's release marks a significant shift in AI model design, focusing on memory as a key resource.
Read originalThe story around this
Earlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.
More in Models & Labs
Models & Labsother
llama.cpp b11193 adds Snapdragon Hexagon and ROCm 10
This release quietly expands llama.cpp's hardware support to include Qualcomm's Hexagon NPU on Linux arm64, a significant step for local inference on Snapdragon devices. It also updates CUDA builds to version 13.4 and introduces ROCm 10.0 binaries, keeping the project aligned with the latest NVIDIA and AMD driver ecosystems. KleidiAI on Apple Silicon is temporarily disabled in this build, likely due to stability checks rather than a feature rollback. For developers targeting edge AI or diverse GPU stacks, this update ensures broader compatibility without requiring custom compilation.
llama.cpp Releases
© Lev SelectorModels & Labsmodels
NVIDIA NVFP4 and SoL-Pi Token Efficiency
NVIDIA introduced the NVFP4 4-bit format and SoL-Pi technology, which uses 2x fewer tokens for improved efficiency.