The b10084 release of llama.cpp has been announced, featuring expanded support across multiple platforms. This update includes builds for Ubuntu with ROCm 7.2, enhancing AMD GPU performance, and extends Vulkan support to various systems. While KleidiAI support for macOS Apple Silicon is disabled, the release offers a wide array of builds for Windows, Linux, and openEuler. This positions llama.cpp as a versatile tool for developers working with diverse hardware configurations.
Read originalThe latest b10083 release of llama.cpp continues its trend of broadening platform compatibility, making it a versatile choice for developers across different systems. Notably, this update includes support for Ubuntu with ROCm 7.2, enhancing performance for AMD GPU users. Windows users benefit from updated CUDA support, with DLLs for both CUDA 12.4 and 13.3, ensuring compatibility with the latest NVIDIA technologies. While no groundbreaking new features are introduced, the release solidifies llama.cpp's position as a flexible inference runtime across diverse hardware setups.
The latest b10085 release of llama.cpp addresses a key issue with the Qwen3-VL vision model's position embedding interpolation. By aligning the interpolation method with the transformers reference, the update ensures more accurate grounding coordinates, particularly for larger and non-square images. This change is crucial for developers working with image processing tasks, as it reduces discrepancies in image scaling. While the update doesn't introduce new models, it enhances the precision of existing functionalities, making llama.cpp a more reliable tool for AI developers.
The b10087 release of llama.cpp marks a significant step in broadening its hardware compatibility, with ROCm 7.2 now available for Ubuntu x64, offering AMD GPU users a more competitive alternative to NVIDIA's CUDA. This update also introduces Vulkan support, enhancing the software's adaptability across different operating systems. While the release doesn't bring new model architectures, the focus remains on making llama.cpp a versatile tool for developers. By expanding support for various hardware configurations, llama.cpp continues to position itself as a go-to solution for diverse development environments.
Grabette is a new open-source system designed to simplify the collection of robot manipulation data. By using a handheld gripper equipped with cameras, it allows users to record tasks without needing a robot or lab setup. This democratizes data collection, enabling anyone to contribute to a large, collaborative dataset. The system is built on standard, easily accessible components, making it accessible for widespread use. This release aims to address the data bottleneck in robot learning by encouraging community participation in building diverse datasets.
© Lev SelectorNous Research, an open-source AI lab, has raised $75 million at a $1.5 billion valuation.
© Lev SelectorTencent has released Hy3, an open-source mixture of experts (MoE) large language model.