Open Source
llama.cpp b10708 Release Expands Platform Support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands GPU compatibility beyond NVIDIA's CUDA with ROCm 7.14 support.
- →Enhances platform versatility with Vulkan support on Ubuntu and Windows.
- →Continues to position llama.cpp as a flexible inference runtime across various architectures.
The b10708 release of llama.cpp has been announced, featuring expanded support for various platforms. This update includes Vulkan support on both Ubuntu and Windows, as well as ROCm 7.14 compatibility, which broadens GPU options beyond NVIDIA's CUDA. Although KleidiAI support for macOS Apple Silicon is disabled, the release maintains a wide range of architecture support, including OpenVINO and SYCL on Windows. This release underscores llama.cpp's efforts to be a comprehensive inference runtime across diverse hardware setups.
Read originalMore from llama.cpp Releases
Models & Labsmodels
Llama.cpp b10704 Release Optimizes CUDA Path
The b10704 release of llama.cpp brings a notable improvement for CUDA users by optimizing the fast mm_ids_helper path for any n_expert_used. This enhancement allows configurations like n_expert_used = 10 to benefit from the fast path, boosting prompt processing speeds from 2334 to 2600 tokens per second on an RTX PRO 6000. While token generation remains unchanged, this update significantly enhances performance for models utilizing multiple experts. The release continues to support diverse platforms, ensuring developers can leverage these improvements across different environments.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10705 Release Enhances Tensor Handling
The latest b10705 release of llama.cpp focuses on refining TENSOR_READ_LAZY handling, particularly enhancing CPU operations by enforcing lazy tensor processing when lazy mode is active. This update aims to optimize performance across various hardware setups. The release maintains compatibility with platforms like macOS, Linux, Windows, and openEuler, with targeted improvements for Vulkan, ROCm, and CUDA environments. While it doesn't introduce new models, the update strengthens the existing framework, making llama.cpp more efficient for developers working with different hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b10706 Release Expands Platform Support
The latest b10706 release of llama.cpp continues its trend of broadening platform compatibility, now supporting a wide array of systems including macOS, Linux, Windows, and openEuler. Notably, this update includes support for Vulkan on Ubuntu and Windows, as well as ROCm 7.14 on Ubuntu and Windows, which enhances GPU utilization options for developers. While KleidiAI support on macOS Apple Silicon is disabled, the release still offers a robust set of configurations for various architectures. This update solidifies llama.cpp's position as a versatile inference runtime across diverse hardware setups.
llama.cpp Releases
More in Open Source
© Lev SelectorOpen Sourcemodels
DeepSeek Harness Gains 200,000 GitHub Stars in a Week
DeepSeek Harness has rapidly gained popularity, reaching nearly 200,000 stars on GitHub within a week of its release.
Lev Selector
© Matt WolfeOpen Sourcemodels
Qwen3.8-27b Model Released Open Source
Alibaba has released the Qwen3.8-27b model as open source, allowing local deployment.
Matt Wolfe
© GitHub ChangelogOpen Sourcecoding
GitHub Enhances License Data Quality
GitHub has significantly improved the accuracy of license data for software components by integrating package registries like npmjs.org and PyPI into its dependency graph. This shift reduces the reliance on the ClearlyDefined service, which often produced complex and confusing results. By prioritizing registry data, GitHub has halved the number of missing licenses, enhancing the reliability of dependency insights and software bills of materials. This update also simplifies license tracking by using version ranges, making it easier to manage license changes over time.
GitHub Changelog