The b10235 release of llama.cpp has been announced, featuring the implementation of the SILU_BACK operation for f32. This update also includes the removal of redundant asserts in the ggml-metal-ops.cpp function, improving code efficiency. The release supports multiple platforms, including macOS, Linux, and Windows, with configurations for Vulkan, ROCm, and CUDA. This update signifies continued enhancements in the llama.cpp project, offering developers improved tools for AI model development.
Read originalThe latest b10226 release of llama.cpp continues its trend of broadening platform compatibility, making it a versatile tool for developers across diverse systems. Notably, this update includes support for Ubuntu with ROCm 7.2, enhancing performance for AMD GPU users. The release also maintains its comprehensive support for Windows, macOS, and Linux, ensuring that developers can leverage llama.cpp's capabilities regardless of their hardware setup. While there are no groundbreaking new features, this update solidifies llama.cpp's position as a flexible and accessible inference runtime for multiple environments.
The latest b10227 release of llama.cpp introduces a specialized parser for Qwen3, enhancing its tool parsing capabilities. This update includes a tagged thinking tool parser and refactoring efforts to improve functionality, such as the addition of a permute helper and support for omitting <tool_call>. These changes aim to streamline the parsing process and improve the overall efficiency of the system. While the release doesn't introduce new models, it strengthens the existing framework, making it more robust for developers working with complex parsing tasks.
© Together AI BlogMoonshot AI has unveiled Kimi K3, a groundbreaking 2.8-trillion-parameter model, marking it as the largest open-weight model available. This model is designed for complex tasks such as long-horizon coding and deep reasoning, competing with top-tier proprietary models like GPT 5.6 Sol. Kimi K3 introduces innovative architectural features like Kimi Delta Attention and Attention Residuals, enhancing its ability to handle extensive context lengths and complex reasoning. This release signifies a major step in open-source AI, offering developers a powerful tool for advanced AI applications.
© Lev SelectorDeepSeek has released version 4 of its Flash model, offering improved performance and capabilities.