Open Source
llama.cpp b9504 release expands platform support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands platform support, making llama.cpp more versatile for developers.
- →Enhances performance for AMD GPU users with ROCm 7.2 support.
- →Focuses on improving runtime experience without introducing new models.
The latest b9504 release of llama.cpp has been announced, featuring expanded support across multiple platforms. This update includes support for Ubuntu with ROCm 7.2, which is particularly beneficial for AMD GPU users. Although some features like KleidiAI on macOS and SYCL on Windows are disabled, the release enhances the tool's versatility. This update is part of llama.cpp's ongoing efforts to improve accessibility and performance across diverse systems.
Read originalMore from llama.cpp Releases
Open Sourcecoding
llama.cpp b9503 release focuses on Gemma 4 fix
The b9503 release of llama.cpp addresses a technical issue with the Gemma 4 audio projector embedding size, enhancing its functionality. By removing the projection_dim from clip_n_mmproj_embd, the update streamlines the codebase. This release ensures better compatibility across macOS, Linux, and Windows, with specific builds for Apple Silicon, ROCm 7.2, and CUDA 12 and 13. While it doesn't introduce new features, the update reflects a commitment to improving the software's reliability and performance. This release is a technical refinement, focusing on stability rather than groundbreaking changes.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9505 release expands platform support
The b9505 release of llama.cpp continues its trend of broadening compatibility across various systems, though with some notable exceptions. While macOS Apple Silicon users see KleidiAI support disabled, the release strengthens its presence on Windows with CUDA 12 and 13 DLLs, and extends Vulkan support to more environments. The inclusion of ROCm 7.2 for Ubuntu x64 users further narrows the gap between AMD and NVIDIA GPU support. This update underscores llama.cpp's commitment to being a versatile inference runtime, though some features remain disabled, indicating ongoing development challenges.
llama.cpp Releases
Models & Labsmodels
llama.cpp b9509 release optimizes token processing
The b9509 release of llama.cpp brings a key optimization by preventing unnecessary checkpoint restores when new tokens are detected. This update ensures that the system only applies a conservative -1 subtraction when no new tokens are present, thereby minimizing redundant KV state restoration. Developers working with token-based tasks will find this change streamlines processing and boosts efficiency. While the release doesn't introduce new models or architectures, it enhances the runtime's performance across macOS, Linux, and Windows, including support for ROCm 7.2 and CUDA 12 and 13. This makes llama.cpp more efficient and adaptable for developers using different hardware configurations.
llama.cpp Releases
More in Open Source
© Google Research BlogOpen Sourceresearch
Google Open Sources AI Hydrology Model for Flood Forecasting
Google has open-sourced its advanced AI-based hydrology model, aiming to enhance global flood forecasting capabilities. This move allows National Meteorological and Hydrological Services to integrate sophisticated AI tools into their workflows, potentially improving the accuracy and timeliness of flood warnings. By releasing the model on GitHub, Google empowers local experts to refine and adapt the technology using their own data, fostering a more resilient approach to flood management. This initiative democratizes access to cutting-edge forecasting tools, especially benefiting regions with limited resources.
Google Research Blog
© TechCrunch AIOpen Sourceagents
Microsoft Introduces Agent Control Specification for AI
Microsoft's new Agent Control Specification (ACS) offers developers a unified way to manage AI agent behavior across various environments. By allowing teams to define specific policies, ACS ensures agents operate within set boundaries, reducing the risk of unintended actions. This open-source standard integrates controls into a common governance layer, making it easier to audit and reuse across different systems. With ACS, developers can maintain consistent oversight, enhancing both security and compliance in AI deployments.
TechCrunch AI
© Lev SelectorOpen Sourcemodels
Cohere Command A+ Open Sourced
Cohere has open-sourced its Command A+ model, making it accessible for public use.
Lev Selector