Open Source
llama.cpp b10050 Release Expands Platform Support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands platform support, increasing accessibility for diverse hardware setups.
- →Enhances compatibility for AMD GPU users with ROCm 7.2 support.
- →Maintains support for NVIDIA users with CUDA 12 and 13.
The b10050 release of llama.cpp has been announced, featuring expanded support across multiple platforms. This update includes Vulkan support for both Ubuntu and Windows, and ROCm 7.2 support on Ubuntu, catering to AMD GPU users. Additionally, it continues to support CUDA 12 and 13 on Windows, providing options for NVIDIA users. While the release does not introduce new model architectures, it enhances the software's versatility and accessibility across different hardware configurations.
Read originalMore from llama.cpp Releases
Models & Labsmodels
llama.cpp b10043 release supports CUDA Virtual Devices
The b10043 release of llama.cpp marks a notable enhancement with the addition of CUDA Virtual Devices, which significantly improves GPU resource management. By removing the NCCL path when virtual devices are in use, the update fine-tunes performance for these specific setups. This release also includes a comprehensive code refactor and the implementation of GPUx2 server CI jobs, reflecting a commitment to better testing and deployment processes. While there are no new model architectures, the update enhances the platform's flexibility across various operating systems, making it more adaptable for developers working with a wide range of hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b10045 Release Expands Platform Support
The b10045 release of llama.cpp focuses on broadening its platform compatibility, though it doesn't introduce major new features. This update notably includes Vulkan support for Ubuntu and Windows, alongside ROCm 7.2 for Ubuntu, enhancing GPU utilization options for developers. While KleidiAI support for macOS Apple Silicon remains disabled, the release still covers a wide array of operating systems and architectures, offering developers increased flexibility in deployment. This update solidifies llama.cpp's position as a versatile inference runtime across multiple systems, rather than delivering groundbreaking changes.
