Open Source
llama.cpp b10318 Release Expands Platform Support
llama.cpp Releaseshigh confidence
Why it matters
- →Expanding platform support increases accessibility for developers using different hardware.
- →ROCm 7.2 support offers a viable alternative for AMD GPU users.
- →Consistent updates ensure llama.cpp remains a flexible tool for AI development.
The b10318 release of llama.cpp has been announced, focusing on expanding platform support across various operating systems. This update includes ROCm 7.2 support on Ubuntu x64, providing an alternative for AMD GPU users. The release also covers a wide range of systems, including macOS, Windows, and Linux, with builds for Vulkan, OpenVINO, and SYCL. Although there are no new model architectures, the release emphasizes llama.cpp's dedication to broad compatibility and developer accessibility.
Read originalMore from llama.cpp Releases
Open Sourcemodels
Llama.cpp b10310 Release Enhances Aarch64 Support
The latest b10310 release of llama.cpp introduces significant improvements for aarch64 architecture, particularly with the addition of HWCAP fallbacks and refined fp16 variant detection. This update ensures better compatibility and performance for devices using aarch64, such as those running on macOS Apple Silicon and various Linux distributions. By requiring HWCAP_ASIMDHP for aarch64 fp16 CPU variants, the release enhances the handling of half-precision arithmetic. While no new models are introduced, these technical adjustments make llama.cpp more robust for developers working across diverse hardware configurations.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10311 Release Enhances TTS Generation
The b10311 release of llama.cpp tackles inefficiencies in text-to-speech (TTS) generation by refining how text streams are processed. Previously, the system would redundantly handle utterances, causing them to be read twice before completion. This update aligns the streaming overlay with the non-streaming prefill, effectively eliminating the duplication. Developers working with TTS systems will find this change streamlines the generation process and boosts efficiency. The update is accessible on macOS, Linux, and Windows, ensuring that a broad range of users can benefit from these improvements.
llama.cpp Releases
Open Sourcemodels
llama.cpp b10312 Release Expands Platform Support
The latest b10312 release of llama.cpp continues its trend of broadening platform compatibility, now including support for a variety of systems such as Ubuntu with ROCm 7.2 and Windows with CUDA 13.3. This update ensures that developers working across different hardware configurations, from Apple Silicon to Windows x64, have access to optimized builds. While there are no groundbreaking new features, the release solidifies llama.cpp's position as a versatile tool for AI inference across multiple systems. This means developers can now more easily integrate llama.cpp into their workflows, regardless of their preferred platform.
llama.cpp Releases
More in Open Source
Open Sourcebusiness
Red Hat launches asago to automate AI governance
Red Hat's new open-source project, asago, aims to transform AI governance policies into actionable deployment code, addressing the growing need for compliance as regulations like the EU AI Act take effect. By automating the translation of policy into risk profiles and deployment-ready configurations, asago seeks to streamline the traditionally manual and cumbersome process of AI safety compliance. This initiative, supported by major players like NVIDIA and IBM, promises to cut deployment timelines significantly, though it remains in its early stages without production-tested results. The project's collaborative nature invites contributions from various sectors, aiming to create a comprehensive framework for AI safety across different jurisdictions.
AI News
© Microsoft ResearchOpen Sourceagents
Microsoft's Orchard Framework Boosts Agentic AI Research
Microsoft Research has unveiled Orchard, an open-source framework designed to advance agentic AI research by providing a scalable and cost-effective environment. Orchard's unique infrastructure supports various agent systems, allowing researchers to train and evaluate agents across different domains like software engineering and web navigation. By enabling training directly within real deployment harnesses, Orchard bridges the gap between research and practical application. This release is significant as it democratizes access to tools and data, empowering the research community to build sophisticated agentic systems without proprietary constraints.
Microsoft Research
© Matt WolfeOpen Sourcemodels
Alibaba Announces Qwen3.8 Open-Weight Release
Alibaba plans to release open weights for its Qwen3.8 model.
Matt Wolfe