Open Source
llama.cpp b10797 Release Expands Platform Support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands llama.cpp's compatibility across diverse hardware platforms.
- →Enhances utility for developers working with Vulkan, ROCm, and CUDA.
- →Strengthens llama.cpp's position as a versatile AI inference tool.
The b10797 release of llama.cpp has been announced, featuring expanded support across multiple platforms. This update includes Vulkan and ROCm 10.0 support on Ubuntu, and CUDA 13 on Windows, catering to developers using various hardware setups. Although KleidiAI support on macOS Apple Silicon is disabled, the release enhances llama.cpp's versatility for AI inference tasks. This update focuses on broadening platform compatibility rather than introducing new models.
Read originalMore from llama.cpp Releases
Models & Labsmodels
llama.cpp b10794 Release Expands Platform Support
The latest b10794 release of llama.cpp continues its trend of broadening platform compatibility, now supporting a wide array of systems including macOS, Linux, Windows, and openEuler. Notably, this update includes support for Vulkan and ROCm 10.0 on Ubuntu, as well as CUDA 13 on Windows, which enhances performance options for developers using these platforms. While the release doesn't introduce new model architectures, it solidifies llama.cpp's position as a versatile inference runtime across diverse hardware configurations. This update is a testament to llama.cpp's commitment to accessibility and performance optimization for developers working with AI models.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10795 release enhances SYCL fusion
The b10795 release of llama.cpp brings notable improvements in SYCL fusion, specifically by combining operations like RMS_NORM+MUL+ADD and ADD+ADD. This enhancement, under GGML_SYCL_ENABLE_FUSION, boosts performance for supported data types, while unsupported combinations revert to standard methods. The update continues to support a wide array of platforms, including macOS with Apple Silicon, Ubuntu with Vulkan, and Windows with CUDA 12 and 13. This makes llama.cpp a robust choice for developers working across different hardware environments, ensuring efficient AI processing and broad compatibility.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10796 Release Adds n_expert_used_max Function
The latest release of llama.cpp, b10796, introduces the n_expert_used_max function, enhancing the model's ability to handle expert layers. This update addresses previous issues where models with expert layers failed to load due to missing checks. By implementing this function, the software can now better manage the number of experts per layer, ensuring smoother model loading and operation. This release doesn't introduce new models but focuses on refining the existing infrastructure to support more complex configurations.
llama.cpp Releases
More in Open Source
© Cole MedinOpen Sourcecoding
AI Software Factory: Open Source Alpha Released
Cole Medin is pioneering a new approach to AI-driven software development with his AI Software Factory. This open-source project automates the entire coding process from a product requirements document to shipped code, without human intervention in the coding phase. Medin's experiment has already produced Dynachat, an AI tutor, demonstrating the potential of this method. Now, he's inviting developers to explore and contribute to the early alpha version, aiming to make this transformative tool accessible to all. This could redefine how software is developed, offering a glimpse into a future where AI handles the heavy lifting of coding.
Cole Medin
© Lev SelectorOpen Sourcemodels
DeepSeek Harness Gains 200,000 GitHub Stars in a Week
DeepSeek Harness has rapidly gained popularity, reaching nearly 200,000 stars on GitHub within a week of its release.
Lev Selector
© Matt WolfeOpen Sourcemodels
Qwen3.8-27b Model Released Open Source
Alibaba has released the Qwen3.8-27b model as open source, allowing local deployment.
Matt Wolfe