Models & Labs
llama.cpp b10232 release enhances Metal support
llama.cpp Releaseshigh confidence
Why it matters
- →Enhances performance on macOS and iOS with optimized Metal support.
- →Expands compatibility across multiple operating systems and hardware configurations.
- →Strengthens llama.cpp's position as a versatile inference runtime.
The b10232 release of llama.cpp focuses on enhancing Metal support with the implementation of DeepSeek V4 hyper-connections. This update includes optimized kernels for SIMDgroup register and shuffle, specifically benefiting macOS and iOS platforms. Additionally, the release broadens compatibility across multiple operating systems, including Ubuntu and Windows, with optimizations for Vulkan, ROCm, and CUDA. These improvements solidify llama.cpp's role as a flexible inference runtime for various hardware setups.
Read originalMore from llama.cpp Releases
Open Sourcemodels
llama.cpp b10226 Release Expands Platform Support
The latest b10226 release of llama.cpp continues its trend of broadening platform compatibility, making it a versatile tool for developers across diverse systems. Notably, this update includes support for Ubuntu with ROCm 7.2, enhancing performance for AMD GPU users. The release also maintains its comprehensive support for Windows, macOS, and Linux, ensuring that developers can leverage llama.cpp's capabilities regardless of their hardware setup. While there are no groundbreaking new features, this update solidifies llama.cpp's position as a flexible and accessible inference runtime for multiple environments.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10227 release enhances tool parsing
The latest b10227 release of llama.cpp introduces a specialized parser for Qwen3, enhancing its tool parsing capabilities. This update includes a tagged thinking tool parser and refactoring efforts to improve functionality, such as the addition of a permute helper and support for omitting <tool_call>. These changes aim to streamline the parsing process and improve the overall efficiency of the system. While the release doesn't introduce new models, it strengthens the existing framework, making it more robust for developers working with complex parsing tasks.
llama.cpp Releases
Open Sourcemodels
llama.cpp b10228 Release Expands Platform Support
The b10228 release of llama.cpp focuses on enhancing platform compatibility without introducing major new features. This update includes ROCm 7.2 support for Ubuntu x64, providing AMD GPU users with a viable alternative to NVIDIA's CUDA. Developers can now access llama.cpp across various systems, including macOS, Windows, and Linux, ensuring its utility in diverse environments. While the release doesn't bring groundbreaking changes, it reinforces llama.cpp's role as a flexible tool for AI inference, accommodating different hardware configurations and developer needs.
llama.cpp Releases
More in Models & Labs
© Together AI BlogModels & Labsmodels
Kimi K3: Largest Open-Weight AI Model Released
Moonshot AI has unveiled Kimi K3, a groundbreaking 2.8-trillion-parameter model, marking it as the largest open-weight model available. This model is designed for complex tasks such as long-horizon coding and deep reasoning, competing with top-tier proprietary models like GPT 5.6 Sol. Kimi K3 introduces innovative architectural features like Kimi Delta Attention and Attention Residuals, enhancing its ability to handle extensive context lengths and complex reasoning. This release signifies a major step in open-source AI, offering developers a powerful tool for advanced AI applications.
Together AI Blog
© Lev SelectorModels & Labsmodels
DeepSeek V4 Flash Released
DeepSeek has released version 4 of its Flash model, offering improved performance and capabilities.
Lev Selector
© Lev SelectorModels & Labsmodels
Anthropic Removes 80% of Claude Code Prompts
Anthropic has streamlined its Claude Code by removing 80% of internal prompts to improve model performance.
Lev Selector