Open Source
llama.cpp b10158 Release Expands Platform Support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands support for AMD GPUs with ROCm 7.2, offering alternatives to CUDA.
- →Maintains broad platform compatibility, ensuring versatility across hardware.
- →Focuses on infrastructure improvements rather than new features.
The b10158 release of llama.cpp has been announced, focusing on expanding platform support rather than introducing new features. Key updates include the addition of ROCm 7.2 support for Ubuntu x64, enhancing options for AMD GPU users. While KleidiAI support for Apple Silicon is disabled, the release maintains broad compatibility across macOS, Linux, Windows, and openEuler platforms. This update highlights llama.cpp's ongoing efforts to provide a versatile inference runtime for various hardware setups.
Read originalMore from llama.cpp Releases
Models & Labsmodels
llama.cpp b10156 Release Expands Platform Support
The latest b10156 release of llama.cpp continues its trend of broadening platform compatibility, notably adding support for ROCm 7.2 on Ubuntu x64. This update ensures that AMD GPU users can leverage llama.cpp more effectively, narrowing the gap with NVIDIA's CUDA. The release also includes Vulkan support for both Ubuntu and Windows, enhancing the versatility of the software for developers. While no new models or quantization methods are introduced, this update solidifies llama.cpp's position as a versatile inference runtime across diverse hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b10159 release enhances Metal backend
The latest b10159 release of llama.cpp introduces a new FWHT kernel for the Metal backend, significantly boosting performance for Apple Silicon users. This update, co-authored by YiChen Lv and Georgi Gerganov, also resolves a narrowing issue and refines formatting and style. Although the KleidiAI feature for macOS Apple Silicon is still disabled, the release maintains compatibility with platforms like Ubuntu, Windows, and openEuler. With ROCm 7.2 and CUDA 12 and 13 support, llama.cpp continues to evolve as a robust inference runtime, catering to diverse hardware configurations.
llama.cpp Releases
Models & Labsmodels
Llama.cpp b10164 Release Enhances CUDA Performance
The latest b10164 release of llama.cpp focuses on improving CUDA performance, particularly for Mamba-2 prefill acceleration. By introducing chunked SSD matrix multiplication, the update aims to enhance efficiency and memory coalescing. This release also addresses several technical fixes, including resolving a read-write race condition in CUDA operations. While there are no groundbreaking new features, these optimizations make llama.cpp a more robust choice for developers working with CUDA and related technologies.
llama.cpp Releases
More in Open Source
© Matt WolfeOpen Sourcemodels
Alibaba Announces Qwen3.8 Open-Weight Release
Alibaba plans to release open weights for its Qwen3.8 model.
Matt Wolfe
© Hugging Face BlogOpen Sourceagents
Grabette: Open System for Robot Data Collection
Grabette is a new open-source system designed to simplify the collection of robot manipulation data. By using a handheld gripper equipped with cameras, it allows users to record tasks without needing a robot or lab setup. This democratizes data collection, enabling anyone to contribute to a large, collaborative dataset. The system is built on standard, easily accessible components, making it accessible for widespread use. This release aims to address the data bottleneck in robot learning by encouraging community participation in building diverse datasets.
Hugging Face Blog
© Lev SelectorInvestment · $75 Mn
Open Sourceresearch
Nous Research Secures $75 Million Funding
Nous Research, an open-source AI lab, has raised $75 million at a $1.5 billion valuation.
Lev Selector