Open Source
llama.cpp b9625 Release Expands Platform Support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands support for AMD GPUs with ROCm 7.2, offering alternatives to CUDA.
- →Reinforces llama.cpp's versatility across diverse operating systems.
- →Maintains a broad array of platform builds, ensuring wide usability.
The b9625 release of llama.cpp has been announced, focusing on expanding platform support rather than introducing new features. This update includes ROCm 7.2 support for Ubuntu x64, enhancing options for AMD GPU users. The release covers a wide range of platforms, including macOS, Linux, Windows, and openEuler, though some configurations like KleidiAI on Apple Silicon are disabled. This update reinforces llama.cpp's position as a versatile tool for AI inference across multiple systems.
Read originalMore from llama.cpp Releases
Open Sourcecoding
llama.cpp b9622 Release Enhances Vulkan Support
The b9622 release of llama.cpp significantly boosts Vulkan capabilities, particularly for non-contiguous unary and glu operations. By refining index calculations with fastdiv and merging unary operations into a single file, the update enhances both performance and code efficiency. It also tackles a compiler bug and resolves earlier conflicts, ensuring smoother functionality across a broad spectrum of hardware setups. While this update doesn't introduce revolutionary features, it strengthens llama.cpp's role as a flexible tool for developers working with diverse hardware, including macOS, Linux, Windows, and openEuler.
llama.cpp Releases
Open Sourcecoding
llama.cpp b9624 Release Expands Platform Support
The b9624 release of llama.cpp enhances its utility by introducing build-time gzip compression, which can optimize performance through reduced file sizes. This update continues to cater to developers working on various systems, including macOS, Linux, Windows, and openEuler, with specific builds for architectures like arm64 and x64. The inclusion of ROCm 7.2 for Ubuntu x64 and CUDA 12 and 13 for Windows x64 highlights its adaptability to different hardware environments. While there are no new model architectures, the release strengthens llama.cpp's role as a flexible tool for developers needing compatibility across diverse setups.
llama.cpp Releases
Models & Labsmodels
Llama.cpp b9626 Release Adds Cohere2-MoE Support
The latest b9626 release of llama.cpp introduces architectural support for the cohere2-MoE model, marking a significant update for developers working with this model. This release also includes various technical improvements such as the removal of redundant checks and enhancements in tensor handling, which streamline the model's performance. By adding cohere2moe to the Llama Model Saver supported list, the update broadens the toolkit available for AI practitioners. While these changes may seem incremental, they collectively enhance the robustness and flexibility of llama.cpp, making it a more versatile tool for AI development.
llama.cpp Releases
More in Open Source
© Hugging Face BlogOpen Sourceagents
OpenEnv Gains Open Source Community Support
OpenEnv is evolving into a pivotal open-source tool for agentic reinforcement learning (RL), now backed by a coalition of major AI organizations including Meta-PyTorch, Nvidia, and Hugging Face. This initiative aims to standardize the interface between RL environments and trainers, promoting interoperability and efficiency. By serving as a common socket for various RL components, OpenEnv facilitates seamless integration across different ecosystems. This move is set to enhance the development of specialized models and harnesses, making RL more accessible and efficient for the open-source community.
Hugging Face Blog
© Lev SelectorOpen Sourcemodels
JetBrains Releases Mellum2 12B MoE Open-source
JetBrains has open-sourced Mellum2, a 12 billion parameter mixture of experts model.
Lev Selector
© Google Research BlogOpen Sourceresearch
Google Open Sources AI Hydrology Model for Flood Forecasting
Google has open-sourced its advanced AI-based hydrology model, aiming to enhance global flood forecasting capabilities. This move allows National Meteorological and Hydrological Services to integrate sophisticated AI tools into their workflows, potentially improving the accuracy and timeliness of flood warnings. By releasing the model on GitHub, Google empowers local experts to refine and adapt the technology using their own data, fostering a more resilient approach to flood management. This initiative democratizes access to cutting-edge forecasting tools, especially benefiting regions with limited resources.
Google Research Blog