Open Source
llama.cpp b10213 Release Expands Platform Support
llama.cpp Releaseshigh confidence
Why it matters
- →Expanding platform support increases accessibility for developers using diverse hardware.
- →ROCm 7.2 support offers a viable alternative for AMD GPU users.
- →Consistent updates ensure llama.cpp remains a relevant tool in AI development.
The b10213 release of llama.cpp has been announced, focusing on expanding platform support across multiple operating systems. This update includes ROCm 7.2 support for Ubuntu x64, enhancing options for AMD GPU users. The release continues to support a wide range of platforms, including Windows, macOS, and Linux, without introducing new model architectures. This consistent platform expansion reinforces llama.cpp's role as a versatile tool for developers working with AI inference.
Read originalMore from llama.cpp Releases
Models & Labsmodels
Llama.cpp b10208 Release Enhances SYCL Performance
The latest b10208 release of llama.cpp introduces significant improvements in SYCL performance, particularly with the addition of oneMKL GEMM flash attention for XMX-accelerated prompt processing. This update addresses previous issues with interleaved destination layouts in the normalize kernel, ensuring more accurate attention outputs across models. By removing redundant stream waits and refining MKL FA dispatch gates, the release optimizes processing speeds, nearly doubling performance in some cases. These enhancements make llama.cpp a more robust and efficient tool for developers working with large language models.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10211 Release Expands Platform Support
The latest b10211 release of llama.cpp continues its trend of broadening platform compatibility, making it a versatile tool for developers across various systems. Notably, this update includes support for Ubuntu with ROCm 7.2, enhancing performance for AMD GPU users. Windows users benefit from the inclusion of CUDA 12 and 13 DLLs, ensuring compatibility with the latest NVIDIA technologies. While the release doesn't introduce new model architectures, it solidifies llama.cpp's position as a flexible inference runtime across diverse hardware configurations.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10212 Release Optimizes MTP Tensor Loading
The b10212 release of llama.cpp brings a significant efficiency boost by ensuring MTP tensors are loaded only when necessary. This optimization, co-authored by Stanisław Szymczyk, targets models that support MTP, reducing unnecessary resource usage. The update is applicable across environments like macOS, Linux, Windows, and openEuler, making it widely relevant. While there are no new models or architectures introduced, the focus on performance and resource management makes llama.cpp more effective for developers. This release quietly enhances the runtime experience, particularly for those leveraging MTP-supported models.
llama.cpp Releases
More in Open Source
© Matt WolfeOpen Sourcemodels
Alibaba Announces Qwen3.8 Open-Weight Release
Alibaba plans to release open weights for its Qwen3.8 model.
Matt Wolfe
© Hugging Face BlogOpen Sourceagents
Grabette: Open System for Robot Data Collection
Grabette is a new open-source system designed to simplify the collection of robot manipulation data. By using a handheld gripper equipped with cameras, it allows users to record tasks without needing a robot or lab setup. This democratizes data collection, enabling anyone to contribute to a large, collaborative dataset. The system is built on standard, easily accessible components, making it accessible for widespread use. This release aims to address the data bottleneck in robot learning by encouraging community participation in building diverse datasets.
Hugging Face Blog
© Lev SelectorInvestment · $75 Mn
Open Sourceresearch
Nous Research Secures $75 Million Funding
Nous Research, an open-source AI lab, has raised $75 million at a $1.5 billion valuation.
Lev Selector