Models & Labs
Moonshot's Kimi 3 to Rival Anthropic's Opus 4.8
TechCrunch AIhigh confidence
Why it matters
- →Moonshot's Kimi 3 could challenge the dominance of closed-source models like Anthropic's Opus 4.8.
- →The model's large parameter count positions it as a significant player in the open-source AI market.
- →It offers a potential alternative for companies wary of the costs and data privacy concerns associated with closed-source models.
Moonshot AI is preparing to launch its Kimi 3 model, which is anticipated to match or exceed the performance of Anthropic's Opus 4.8. The Kimi 3 will reportedly be the largest open-weight AI model from China, with a parameter count between 2 trillion and 3 trillion. This development comes as the industry debates the value of costly, closed-source AI models, with some executives advocating for open-source alternatives. Moonshot's upcoming release could provide a significant option for companies looking to leverage advanced AI capabilities without the high costs of proprietary models.
Read originalMore from TechCrunch AI
More in Models & Labs
Models & Labsmodels
llama.cpp b10043 release supports CUDA Virtual Devices
The b10043 release of llama.cpp marks a notable enhancement with the addition of CUDA Virtual Devices, which significantly improves GPU resource management. By removing the NCCL path when virtual devices are in use, the update fine-tunes performance for these specific setups. This release also includes a comprehensive code refactor and the implementation of GPUx2 server CI jobs, reflecting a commitment to better testing and deployment processes. While there are no new model architectures, the update enhances the platform's flexibility across various operating systems, making it more adaptable for developers working with a wide range of hardware configurations.
llama.cpp Releases
Models & Labsmodels
Llama.cpp b10051 Release Enhances SME Kernel Dispatch
The latest release of llama.cpp, b10051, addresses a critical issue in kernel dispatch by distinguishing between SME and SME2 capabilities. Previously, the integration treated SME as a single capability, leading to incorrect dispatch on SME(v1)-only hardware due to the use of SME2-specific instructions. This update introduces both build-time and runtime distinctions, ensuring that kernels are dispatched based on actual hardware support. This refinement enhances the accuracy and efficiency of operations on different hardware configurations, marking a significant improvement for developers working with these systems.
