Open Source
llama.cpp b10706 Release Expands Platform Support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands platform compatibility, making llama.cpp more versatile for developers.
- →Enhances GPU utilization options with Vulkan and ROCm support.
- →Strengthens llama.cpp's position as a flexible inference runtime.
The b10706 release of llama.cpp has been announced, featuring expanded support across multiple platforms including macOS, Linux, Windows, and openEuler. Key updates include Vulkan support on Ubuntu and Windows, and ROCm 7.14 on both Ubuntu and Windows, enhancing GPU capabilities. Although KleidiAI support is disabled on macOS Apple Silicon, the release maintains a comprehensive range of configurations for different architectures. This update reinforces llama.cpp's adaptability as an inference runtime across various hardware environments.
Read originalMore from llama.cpp Releases
Models & Labsmodels
Llama.cpp b10704 Release Optimizes CUDA Path
The b10704 release of llama.cpp brings a notable improvement for CUDA users by optimizing the fast mm_ids_helper path for any n_expert_used. This enhancement allows configurations like n_expert_used = 10 to benefit from the fast path, boosting prompt processing speeds from 2334 to 2600 tokens per second on an RTX PRO 6000. While token generation remains unchanged, this update significantly enhances performance for models utilizing multiple experts. The release continues to support diverse platforms, ensuring developers can leverage these improvements across different environments.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10705 Release Enhances Tensor Handling
The latest b10705 release of llama.cpp focuses on refining TENSOR_READ_LAZY handling, particularly enhancing CPU operations by enforcing lazy tensor processing when lazy mode is active. This update aims to optimize performance across various hardware setups. The release maintains compatibility with platforms like macOS, Linux, Windows, and openEuler, with targeted improvements for Vulkan, ROCm, and CUDA environments. While it doesn't introduce new models, the update strengthens the existing framework, making llama.cpp more efficient for developers working with different hardware configurations.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10707 release improves sequence scan efficiency
The latest b10707 release of llama.cpp introduces a significant optimization in sequence scanning, enhancing performance without altering behavior. By stopping the sequence scan once all relevant sequences are seen, the update boosts context generation speeds notably, with 55k context generation improving from 56.3 to 74.3 tokens per second. This change primarily affects the n-gram path, with gains increasing alongside context size. While prompt processing remains unchanged, the update demonstrates llama.cpp's ongoing commitment to refining performance for developers working with large contexts.
llama.cpp Releases
More in Open Source
© Lev SelectorOpen Sourcemodels
DeepSeek Harness Gains 200,000 GitHub Stars in a Week
DeepSeek Harness has rapidly gained popularity, reaching nearly 200,000 stars on GitHub within a week of its release.
Lev Selector
© Matt WolfeOpen Sourcemodels
Qwen3.8-27b Model Released Open Source
Alibaba has released the Qwen3.8-27b model as open source, allowing local deployment.
Matt Wolfe
© GitHub ChangelogOpen Sourcecoding
GitHub Enhances License Data Quality
GitHub has significantly improved the accuracy of license data for software components by integrating package registries like npmjs.org and PyPI into its dependency graph. This shift reduces the reliance on the ClearlyDefined service, which often produced complex and confusing results. By prioritizing registry data, GitHub has halved the number of missing licenses, enhancing the reliability of dependency insights and software bills of materials. This update also simplifies license tracking by using version ranges, making it easier to manage license changes over time.
GitHub Changelog