The b10656 release of llama.cpp has been announced, expanding its support across multiple platforms including macOS, Linux, Windows, and openEuler. This update introduces Vulkan and ROCm 7.14 support on Ubuntu, and CUDA 13 on Windows, enhancing compatibility with both AMD and NVIDIA GPUs. Although KleidiAI support for Apple Silicon is currently disabled, the release strengthens llama.cpp's adaptability across various hardware setups. This update focuses on platform expansion rather than new model introductions, reinforcing llama.cpp's role as a versatile tool for developers.
Read originalThe b10657 release of llama.cpp brings new OpenCL binary kernels, enhancing performance and compatibility across a wide range of systems. This update includes specific improvements for Apple Silicon, with KleidiAI support, and Vulkan on Ubuntu, making it more accessible for developers using these platforms. While no new model architectures are introduced, the release focuses on strengthening llama.cpp's capabilities as an inference runtime, particularly for those not using NVIDIA hardware. With ROCm 7.14 support on Ubuntu and CUDA 12 and 13 DLLs for Windows, llama.cpp continues to evolve as a versatile tool for AI model deployment. This release underscores the commitment to broadening hardware compatibility and optimizing performance across different environments.
The b10658 release of llama.cpp marks a significant enhancement with the addition of DFlash2, which boosts local convolution and candidate selection capabilities. This update, with contributions from Claude Opus 5, focuses on optimizing costs and refining the code structure for better performance and maintainability. It also resolves several bugs and formatting issues, ensuring a more stable runtime. These improvements make llama.cpp more robust and efficient, catering to developers across various platforms. The release continues to solidify llama.cpp's position as a versatile tool for AI development.
The b10659 release of llama.cpp brings a crucial update for Windows users by including HIP runtime DLLs with the Windows ROCm package. This ensures that the correct HIP runtime is prioritized over the driver's version in System32, effectively solving a previous issue. Although this update doesn't introduce new model architectures or quantization techniques, it significantly enhances the platform's compatibility and performance. Developers working on AI tasks in Windows environments can now expect a more streamlined setup process and potentially better runtime performance.
© Lev SelectorDeepSeek Harness has rapidly gained popularity, reaching nearly 200,000 stars on GitHub within a week of its release.
© Matt WolfeAlibaba has released the Qwen3.8-27b model as open source, allowing local deployment.
© GitHub ChangelogGitHub has significantly improved the accuracy of license data for software components by integrating package registries like npmjs.org and PyPI into its dependency graph. This shift reduces the reliance on the ClearlyDefined service, which often produced complex and confusing results. By prioritizing registry data, GitHub has halved the number of missing licenses, enhancing the reliability of dependency insights and software bills of materials. This update also simplifies license tracking by using version ranges, making it easier to manage license changes over time.