
Moonshot AI has released Kimi K3, a 2.8-trillion-parameter model, making it the largest open-weight AI model to date. Designed for advanced tasks such as long-horizon coding and deep reasoning, Kimi K3 competes with leading proprietary models like GPT 5.6 Sol. It features new architectural innovations, including Kimi Delta Attention and Attention Residuals, which improve its ability to process long sequences and complex tasks. This release represents a significant advancement in open-source AI, providing developers with a powerful new tool for sophisticated AI applications.
Read originalThe latest b10227 release of llama.cpp introduces a specialized parser for Qwen3, enhancing its tool parsing capabilities. This update includes a tagged thinking tool parser and refactoring efforts to improve functionality, such as the addition of a permute helper and support for omitting <tool_call>. These changes aim to streamline the parsing process and improve the overall efficiency of the system. While the release doesn't introduce new models, it strengthens the existing framework, making it more robust for developers working with complex parsing tasks.
The b10231 release of llama.cpp brings significant improvements to DSpark sidecar resolution, making it the default choice over DFlash due to its additional Markov head. This update allows for resolving sidecars without needing a full model at the tag, and provides an option to disable discovery with explicit -md selection. While no new models are introduced, the release extends platform support across macOS, Linux, Windows, and openEuler, enhancing its adaptability for developers. With these changes, llama.cpp continues to evolve as a flexible inference runtime, catering to a wide range of system configurations.
The b10232 release of llama.cpp brings notable improvements with the introduction of DeepSeek V4 hyper-connections, specifically optimized for Metal. This update features new SIMDgroup register and shuffle optimized kernels, enhancing performance on macOS and iOS devices. The release also extends support to platforms like Ubuntu and Windows, with targeted optimizations for Vulkan, ROCm, and CUDA environments. While no new models are introduced, these enhancements reinforce llama.cpp's capability as a flexible inference runtime, catering to a wide range of hardware setups.