Open Source
llama.cpp b9947 Release Expands Platform Support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands platform support, enhancing versatility for developers.
- →ROCm 7.2 support offers a viable alternative to CUDA for AMD users.
- →Reinforces llama.cpp's role as a flexible inference runtime.
The b9947 release of llama.cpp has been announced, focusing on expanding platform support rather than introducing new features. Key updates include the addition of ROCm 7.2 support for Ubuntu x64, enhancing options for AMD GPU users. The release also maintains compatibility across various systems, including Windows with CUDA 13 and Ubuntu with Vulkan. While KleidiAI support for Apple Silicon is disabled, the update reinforces llama.cpp's position as a flexible tool for AI inference across diverse environments.
Read originalMore from llama.cpp Releases
Models & Labsmodels
llama.cpp b10618 Release Enhances Parsing
The b10618 release of llama.cpp tackles a crucial parsing issue, specifically improving the handling of hyphens in character classes. This update ensures that generated tool-call grammars are parsed correctly, enhancing the software's reliability. With new parser and integration tests included, the release verifies these improvements effectively. While it doesn't introduce major new features, this update strengthens llama.cpp's core functionality, making it more dependable for developers working on different operating systems and hardware configurations.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10620 Release Expands Platform Support
The b10620 release of llama.cpp marks another step in broadening its platform reach, now supporting systems like Ubuntu with Vulkan and ROCm 7.14, alongside Windows with CUDA 13. This update underscores llama.cpp's adaptability, making it a go-to tool for developers working across various hardware configurations, from macOS Apple Silicon to Windows arm64. While the release doesn't introduce new groundbreaking features, it reinforces llama.cpp's role as a flexible inference runtime. By ensuring compatibility with more systems, llama.cpp becomes increasingly accessible to developers, allowing them to leverage its capabilities regardless of their hardware setup.
llama.cpp Releases
Models & Labsmodels
llama.cpp releases version 0.3.0
The latest llama.cpp release, version 0.3.0, brings a notable expansion in platform compatibility and functionality. This update enhances support for macOS, Linux, Windows, and openEuler, accommodating architectures like Apple Silicon and Vulkan. Developers will find the inclusion of CUDA 13 on Windows, albeit in preview, and ROCm 7.14 on Ubuntu particularly useful. While the release doesn't introduce groundbreaking features, it solidifies llama.cpp's role as a flexible tool for developers working across different computing environments. The update ensures that llama.cpp remains a reliable choice for those needing robust support across multiple systems.
llama.cpp Releases
More in Open Source
© Lev SelectorOpen Sourcemodels
DeepSeek Harness Gains 200,000 GitHub Stars in a Week
DeepSeek Harness has rapidly gained popularity, reaching nearly 200,000 stars on GitHub within a week of its release.
Lev Selector
© GitHub ChangelogOpen Sourcecoding
GitHub Enhances License Data Quality
GitHub has significantly improved the accuracy of license data for software components by integrating package registries like npmjs.org and PyPI into its dependency graph. This shift reduces the reliance on the ClearlyDefined service, which often produced complex and confusing results. By prioritizing registry data, GitHub has halved the number of missing licenses, enhancing the reliability of dependency insights and software bills of materials. This update also simplifies license tracking by using version ranges, making it easier to manage license changes over time.
GitHub Changelog
© NVIDIA BlogOpen Sourceagents
NVIDIA Boosts Local AI with New Open Models
NVIDIA is making strides in the open-source AI ecosystem by releasing several new models and tools that enhance local AI capabilities. Notably, the Cosmos 3 Edge model for robotics and autonomous vehicles, and the MiniMax-H3 model for video and audio generation, are optimized for NVIDIA GPUs, allowing developers to run complex AI tasks locally. This push towards local AI is further supported by the launch of Unsloth Desktop, a comprehensive open-source app for AI model training and inference. These developments signify a shift towards more accessible and efficient AI processing on personal devices, reducing reliance on cloud-based solutions.
NVIDIA Blog