Open Source
llama.cpp b10312 Release Expands Platform Support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands platform compatibility, making it accessible to more developers.
- →Supports diverse hardware configurations, enhancing usability.
- →Strengthens llama.cpp's position as a versatile AI inference tool.
The b10312 release of llama.cpp has been announced, featuring expanded support for multiple platforms. Key additions include Ubuntu x64 with ROCm 7.2 and Windows x64 with CUDA 13.3, catering to a wide range of hardware configurations. This update does not introduce new model architectures but enhances the tool's versatility for developers. By broadening its platform compatibility, llama.cpp continues to be a reliable choice for AI inference across various systems.
Read originalMore from llama.cpp Releases
Open Sourcemodels
Llama.cpp b10310 Release Enhances Aarch64 Support
The latest b10310 release of llama.cpp introduces significant improvements for aarch64 architecture, particularly with the addition of HWCAP fallbacks and refined fp16 variant detection. This update ensures better compatibility and performance for devices using aarch64, such as those running on macOS Apple Silicon and various Linux distributions. By requiring HWCAP_ASIMDHP for aarch64 fp16 CPU variants, the release enhances the handling of half-precision arithmetic. While no new models are introduced, these technical adjustments make llama.cpp more robust for developers working across diverse hardware configurations.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10311 Release Enhances TTS Generation
The b10311 release of llama.cpp tackles inefficiencies in text-to-speech (TTS) generation by refining how text streams are processed. Previously, the system would redundantly handle utterances, causing them to be read twice before completion. This update aligns the streaming overlay with the non-streaming prefill, effectively eliminating the duplication. Developers working with TTS systems will find this change streamlines the generation process and boosts efficiency. The update is accessible on macOS, Linux, and Windows, ensuring that a broad range of users can benefit from these improvements.
llama.cpp Releases
Models & Labsmodels
Llama.cpp b10313 Release Adds LRU Scheduler
The b10313 release of llama.cpp introduces an LRU scheduler, significantly enhancing task management efficiency. This update includes improvements in handling coalescing, optimizing the waiting queue, and fixes for stream cases to ensure smoother operations. The release also expands platform-specific builds, such as Vulkan and ROCm 7.2 support on Ubuntu, and CUDA 12 and 13 on Windows. While there are no new model architectures, these updates demonstrate a commitment to refining performance and compatibility across various systems.
llama.cpp Releases
More in Open Source
Open Sourcebusiness
Red Hat launches asago to automate AI governance
Red Hat's new open-source project, asago, aims to transform AI governance policies into actionable deployment code, addressing the growing need for compliance as regulations like the EU AI Act take effect. By automating the translation of policy into risk profiles and deployment-ready configurations, asago seeks to streamline the traditionally manual and cumbersome process of AI safety compliance. This initiative, supported by major players like NVIDIA and IBM, promises to cut deployment timelines significantly, though it remains in its early stages without production-tested results. The project's collaborative nature invites contributions from various sectors, aiming to create a comprehensive framework for AI safety across different jurisdictions.
AI News
© Microsoft ResearchOpen Sourceagents
Microsoft's Orchard Framework Boosts Agentic AI Research
Microsoft Research has unveiled Orchard, an open-source framework designed to advance agentic AI research by providing a scalable and cost-effective environment. Orchard's unique infrastructure supports various agent systems, allowing researchers to train and evaluate agents across different domains like software engineering and web navigation. By enabling training directly within real deployment harnesses, Orchard bridges the gap between research and practical application. This release is significant as it democratizes access to tools and data, empowering the research community to build sophisticated agentic systems without proprietary constraints.
Microsoft Research
© Matt WolfeOpen Sourcemodels
Alibaba Announces Qwen3.8 Open-Weight Release
Alibaba plans to release open weights for its Qwen3.8 model.
Matt Wolfe