The b10228 release of llama.cpp has been announced, focusing on expanding platform support rather than introducing new features. This update includes ROCm 7.2 support for Ubuntu x64, enhancing options for AMD GPU users. The release also covers a wide array of builds for macOS, Windows, and Linux, ensuring compatibility across different hardware. While not revolutionary, this release reinforces llama.cpp's role as a flexible AI inference tool.
Read originalThe latest b10226 release of llama.cpp continues its trend of broadening platform compatibility, making it a versatile tool for developers across diverse systems. Notably, this update includes support for Ubuntu with ROCm 7.2, enhancing performance for AMD GPU users. The release also maintains its comprehensive support for Windows, macOS, and Linux, ensuring that developers can leverage llama.cpp's capabilities regardless of their hardware setup. While there are no groundbreaking new features, this update solidifies llama.cpp's position as a flexible and accessible inference runtime for multiple environments.
The latest b10227 release of llama.cpp introduces a specialized parser for Qwen3, enhancing its tool parsing capabilities. This update includes a tagged thinking tool parser and refactoring efforts to improve functionality, such as the addition of a permute helper and support for omitting <tool_call>. These changes aim to streamline the parsing process and improve the overall efficiency of the system. While the release doesn't introduce new models, it strengthens the existing framework, making it more robust for developers working with complex parsing tasks.
The b10231 release of llama.cpp brings significant improvements to DSpark sidecar resolution, making it the default choice over DFlash due to its additional Markov head. This update allows for resolving sidecars without needing a full model at the tag, and provides an option to disable discovery with explicit -md selection. While no new models are introduced, the release extends platform support across macOS, Linux, Windows, and openEuler, enhancing its adaptability for developers. With these changes, llama.cpp continues to evolve as a flexible inference runtime, catering to a wide range of system configurations.
© Matt WolfeAlibaba plans to release open weights for its Qwen3.8 model.
Grabette is a new open-source system designed to simplify the collection of robot manipulation data. By using a handheld gripper equipped with cameras, it allows users to record tasks without needing a robot or lab setup. This democratizes data collection, enabling anyone to contribute to a large, collaborative dataset. The system is built on standard, easily accessible components, making it accessible for widespread use. This release aims to address the data bottleneck in robot learning by encouraging community participation in building diverse datasets.
© Lev SelectorNous Research, an open-source AI lab, has raised $75 million at a $1.5 billion valuation.