Open Source
Latest AI signals in this category
Open Sourcecoding
llama.cpp b9622 Release Enhances Vulkan Support
The b9622 release of llama.cpp significantly boosts Vulkan capabilities, particularly for non-contiguous unary and glu operations. By refining index calculations with fastdiv and merging unary operations into a single file, the update enhances both performance and code efficiency. It also tackles a compiler bug and resolves earlier conflicts, ensuring smoother functionality across a broad spectrum of hardware setups. While this update doesn't introduce revolutionary features, it strengthens llama.cpp's role as a flexible tool for developers working with diverse hardware, including macOS, Linux, Windows, and openEuler.
llama.cpp Releases
Open Sourcecoding
llama.cpp b9624 Release Expands Platform Support
The b9624 release of llama.cpp enhances its utility by introducing build-time gzip compression, which can optimize performance through reduced file sizes. This update continues to cater to developers working on various systems, including macOS, Linux, Windows, and openEuler, with specific builds for architectures like arm64 and x64. The inclusion of ROCm 7.2 for Ubuntu x64 and CUDA 12 and 13 for Windows x64 highlights its adaptability to different hardware environments. While there are no new model architectures, the release strengthens llama.cpp's role as a flexible tool for developers needing compatibility across diverse setups.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9625 Release Expands Platform Support
The latest b9625 release of llama.cpp continues its trend of broadening platform compatibility, though without any groundbreaking new features. Notably, it includes support for ROCm 7.2 on Ubuntu x64, which is significant for AMD GPU users seeking alternatives to NVIDIA's CUDA. The release also maintains a wide array of builds across macOS, Linux, Windows, and openEuler, though some configurations like KleidiAI on Apple Silicon remain disabled. While this update doesn't introduce new models or quantization methods, it solidifies llama.cpp's role as a versatile inference runtime across diverse systems.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9596 Release Expands Platform Support
The b9596 release of llama.cpp marks another step in broadening its compatibility, with ROCm 7.2 now supported on Ubuntu x64, enhancing the experience for AMD GPU users. This update helps close the performance gap with NVIDIA's CUDA, making llama.cpp a more attractive option for developers using AMD hardware. Although features like KleidiAI on macOS Apple Silicon are still disabled, the release underscores llama.cpp's commitment to becoming a versatile tool across different systems. Developers can now tap into improved performance on a wider array of hardware, though some expected features remain on the horizon.
llama.cpp Releases
Open Sourcemodels
Llama.cpp b9564 Release Enhances WebGPU Support
The b9564 release of llama.cpp marks a notable enhancement in WebGPU capabilities, specifically through the implementation of 2D workgroups for operations like scale, binary, and unary functions. This update is designed to boost performance across macOS, Linux, and Windows systems. While the KleidiAI feature on Apple Silicon remains inactive, the release broadens hardware compatibility, including Vulkan and ROCm 7.2 support on Ubuntu. By refining these technical aspects, llama.cpp becomes a more flexible tool for developers dealing with a range of computing environments, making it a valuable asset for those working with CUDA and other advanced configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9567 release expands platform support
The b9567 release of llama.cpp continues its trend of broadening platform compatibility, though with some notable exceptions. While macOS Apple Silicon users see KleidiAI support disabled, the release strengthens its Linux offerings with ROCm 7.2 and Vulkan support on Ubuntu. Windows users benefit from CUDA 12 and 13 DLLs, enhancing GPU performance. However, some features like SYCL on Windows and macOS remain disabled, indicating ongoing development challenges. This release reflects llama.cpp's commitment to becoming a versatile inference runtime across diverse hardware setups.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9570 Release Expands Platform Support
The b9570 release of llama.cpp continues to broaden its platform compatibility, notably adding support for ROCm 7.2 on Ubuntu x64, which enhances performance for AMD GPU users. While KleidiAI support on Apple Silicon is disabled, the release maintains a strong focus on diverse operating systems, including Windows and openEuler. This update doesn't introduce new models but strengthens llama.cpp's position as a versatile inference runtime across multiple architectures. Users can now leverage improved GPU support, making it a more attractive option for developers working with non-NVIDIA hardware.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9571 Release Expands Platform Support
The latest b9571 release of llama.cpp continues its trend of broadening platform compatibility, notably adding support for ROCm 7.2 on Ubuntu x64. This update ensures that AMD GPU users can leverage llama.cpp more effectively, narrowing the gap with NVIDIA's CUDA. The release also maintains a focus on diverse operating systems, including macOS, Windows, and openEuler, though some features like KleidiAI on Apple Silicon remain disabled. This iteration doesn't introduce new models but solidifies llama.cpp's position as a versatile inference runtime across multiple environments.
llama.cpp Releases
© Hugging Face BlogOpen Sourceagents
OpenEnv Gains Open Source Community Support
OpenEnv is evolving into a pivotal open-source tool for agentic reinforcement learning (RL), now backed by a coalition of major AI organizations including Meta-PyTorch, Nvidia, and Hugging Face. This initiative aims to standardize the interface between RL environments and trainers, promoting interoperability and efficiency. By serving as a common socket for various RL components, OpenEnv facilitates seamless integration across different ecosystems. This move is set to enhance the development of specialized models and harnesses, making RL more accessible and efficient for the open-source community.
Hugging Face Blog
Open Sourcemodels
llama.cpp b9533 release expands platform support
The b9533 release of llama.cpp continues its focus on enhancing platform compatibility, though some features are notably absent. While macOS Apple Silicon users will find KleidiAI support disabled, the release introduces Vulkan support for both Ubuntu and Windows, and keeps CUDA support updated with new DLLs for Windows. The addition of ROCm 7.2 for Ubuntu x64 is particularly important for AMD GPU users, helping to close the gap with NVIDIA's CUDA. This update is more about refining existing capabilities and ensuring that llama.cpp runs smoothly across various environments, rather than unveiling new model architectures.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9535 release expands platform support
The b9535 release of llama.cpp continues to broaden its platform compatibility, though some features remain unavailable. While macOS Apple Silicon users won't see KleidiAI support this time, the release introduces Vulkan support for both Ubuntu and Windows, offering more options for GPU utilization. The addition of ROCm 7.2 for Ubuntu x64 marks a significant step towards better AMD GPU support, helping to close the gap with NVIDIA's CUDA. However, features like SYCL support are still not enabled, indicating areas where development is ongoing. This release reflects llama.cpp's ongoing efforts to become a versatile inference runtime across a wide range of hardware setups.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9537 Release Expands Platform Support
The b9537 release of llama.cpp continues its trend of broadening platform compatibility, though with some notable exceptions. While macOS Apple Silicon users see KleidiAI support disabled, the release strengthens its Linux offerings with ROCm 7.2 and Vulkan support across multiple architectures. Windows users benefit from CUDA 12 and 13 DLLs, enhancing GPU performance options. Despite some disabled features, this update demonstrates llama.cpp's commitment to being a versatile inference runtime across diverse systems, though it remains a work in progress for certain configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9538 Release Expands Platform Support
The latest b9538 release of llama.cpp continues its trend of broadening platform compatibility, notably adding support for ROCm 7.2 on Ubuntu x64. This update ensures that AMD GPU users can leverage llama.cpp more effectively, narrowing the gap with NVIDIA's CUDA. While some features like KleidiAI on Apple Silicon remain disabled, the release still marks a significant step in making llama.cpp a versatile tool across different hardware setups. The inclusion of Vulkan support on various operating systems further enhances its utility for developers looking to optimize performance across different hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9542 Release Expands Platform Support
The latest b9542 release of llama.cpp continues its trend of broadening platform compatibility, though with some notable exceptions. While macOS Apple Silicon support remains robust, the KleidiAI feature is disabled, indicating a shift in focus. On Windows, the inclusion of CUDA 12 and 13 DLLs highlights a commitment to supporting NVIDIA's latest technologies. However, some features like SYCL on Windows and macOS remain disabled, suggesting ongoing development challenges. This release reflects llama.cpp's strategy of incremental platform expansion while navigating technical hurdles.
llama.cpp Releases
Open Sourcecoding
llama.cpp b9503 release focuses on Gemma 4 fix
The b9503 release of llama.cpp addresses a technical issue with the Gemma 4 audio projector embedding size, enhancing its functionality. By removing the projection_dim from clip_n_mmproj_embd, the update streamlines the codebase. This release ensures better compatibility across macOS, Linux, and Windows, with specific builds for Apple Silicon, ROCm 7.2, and CUDA 12 and 13. While it doesn't introduce new features, the update reflects a commitment to improving the software's reliability and performance. This release is a technical refinement, focusing on stability rather than groundbreaking changes.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9504 release expands platform support
The b9504 release of llama.cpp continues to broaden its reach, enhancing compatibility across multiple environments. This update notably includes support for Ubuntu with ROCm 7.2, which boosts performance for AMD GPU users. While features like KleidiAI on macOS and SYCL on Windows are not yet active, the release still represents a significant step in making llama.cpp a more adaptable tool for developers. By focusing on expanding compatibility and improving the runtime experience, this update strengthens llama.cpp's position as a versatile option for developers working with different systems.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9505 release expands platform support
The b9505 release of llama.cpp continues its trend of broadening compatibility across various systems, though with some notable exceptions. While macOS Apple Silicon users see KleidiAI support disabled, the release strengthens its presence on Windows with CUDA 12 and 13 DLLs, and extends Vulkan support to more environments. The inclusion of ROCm 7.2 for Ubuntu x64 users further narrows the gap between AMD and NVIDIA GPU support. This update underscores llama.cpp's commitment to being a versatile inference runtime, though some features remain disabled, indicating ongoing development challenges.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9512 Release Expands Platform Support
The b9512 release of llama.cpp marks another step in broadening its platform reach, though not without some limitations. While support for KleidiAI on macOS Apple Silicon is currently disabled, the update enhances Ubuntu's capabilities with ROCm 7.2 and Vulkan support. Windows users gain improved GPU compatibility through the inclusion of CUDA 12 and 13 DLLs. Despite these advancements, certain features like SYCL support remain inactive. This release demonstrates llama.cpp's ongoing efforts to be a versatile inference runtime, though some areas still need attention.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9515 Release Enhances Code Efficiency
The b9515 release of llama.cpp enhances code efficiency by consolidating duplicated imatrix code into a single common loader. This update also reintroduces LLAMA_TRACE and implements an early exit for missing metadata during quantization. While there are no groundbreaking new features, the release supports a wide range of platforms, including macOS, Linux, Windows, and openEuler, with specific builds for Vulkan, ROCm, and CUDA. This update is a step towards making the codebase more maintainable and efficient for developers, ensuring smoother operations across various environments.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9518 release expands platform support
The b9518 release of llama.cpp continues its trend of broadening platform support, with ROCm 7.2 now available for Ubuntu x64, offering AMD GPU users improved performance options. Although features like KleidiAI on macOS Apple Silicon are still disabled, the release provides a wide array of builds across macOS, Linux, Windows, and openEuler. This update doesn't bring new models or quantization methods but focuses on making llama.cpp more versatile across different hardware configurations. The release highlights llama.cpp's commitment to being a flexible inference runtime for various systems.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9489 release enhances CUDA support
The b9489 release of llama.cpp brings notable improvements for CUDA users, specifically by reserving space for quantized key-value caches at startup. This update also addresses previous feedback and removes certain assertions in the ggml-cuda.cu file, enhancing the CUDA experience. While it doesn't introduce new models or quantization techniques, the release continues to refine the platform's compatibility across macOS, Linux, and Windows. With ROCm 7.2 and KleidiAI support, llama.cpp is becoming a more robust tool for developers working with CUDA and other environments. This iteration is a step towards making llama.cpp a more versatile and efficient tool for AI development.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9490 Release Expands Platform Support
The latest b9490 release of llama.cpp continues its trend of broadening platform compatibility, though with some notable exceptions. While macOS Apple Silicon users see KleidiAI support disabled, the release strengthens its Linux offerings with Vulkan and ROCm 7.2 support on Ubuntu. Windows users benefit from CUDA 12 and 13 DLLs, enhancing GPU performance options. Despite some features being disabled, this update demonstrates llama.cpp's commitment to being a versatile inference runtime across diverse systems.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9493 Release Expands Platform Support
The b9493 release of llama.cpp continues to broaden its platform reach, notably integrating ROCm 7.2 for Ubuntu x64, which offers better support for AMD GPU users. Although features like KleidiAI on macOS Apple Silicon remain inactive, the update emphasizes extending functionality across various systems, including Vulkan support for both Ubuntu and Windows. While no new models are introduced, this release strengthens llama.cpp's role as a versatile inference runtime across multiple operating systems. Developers can now take advantage of improved GPU support, making it a more inclusive tool for those working outside the NVIDIA ecosystem.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9494 release expands platform support
The b9494 release of llama.cpp continues its trend of broadening platform compatibility, though with some notable exceptions. While macOS Apple Silicon users see KleidiAI support disabled, the release adds Vulkan support for Ubuntu and Windows, and maintains CUDA support with updated DLLs for Windows. The inclusion of ROCm 7.2 for Ubuntu x64 is a significant step for AMD GPU users, ensuring they are not left behind in the AI development race. This update solidifies llama.cpp's position as a versatile tool across diverse operating systems, though some features remain disabled, indicating ongoing development challenges.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9495 release enhances platform support
The b9495 release of llama.cpp introduces significant updates, particularly with the qwen35 model now using post-norm hidden states for MTP. This version also changes 'pre_norm' to 'nextn', signaling a shift in the framework's approach. Although features like KleidiAI on macOS Apple Silicon are still disabled, the update broadens compatibility, notably adding support for Ubuntu with ROCm 7.2 and Windows with CUDA 12 and 13. These enhancements make llama.cpp more adaptable for developers working on diverse systems, improving its utility and performance.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9496 release expands platform support
The b9496 release of llama.cpp continues to broaden its platform compatibility, although some features are notably absent. MacOS Apple Silicon users will find KleidiAI support disabled, while Ubuntu gains strength with ROCm 7.2 and Vulkan support. Windows users benefit from the inclusion of CUDA 12 and 13 DLLs, which enhance GPU performance options. Despite certain features being disabled, this release highlights llama.cpp's ongoing commitment to being a versatile inference runtime across diverse systems. The focus remains on improving accessibility and performance across various hardware configurations.
llama.cpp Releases
© Google Research BlogOpen Sourceresearch
Google Open Sources AI Hydrology Model for Flood Forecasting
Google has open-sourced its advanced AI-based hydrology model, aiming to enhance global flood forecasting capabilities. This move allows National Meteorological and Hydrological Services to integrate sophisticated AI tools into their workflows, potentially improving the accuracy and timeliness of flood warnings. By releasing the model on GitHub, Google empowers local experts to refine and adapt the technology using their own data, fostering a more resilient approach to flood management. This initiative democratizes access to cutting-edge forecasting tools, especially benefiting regions with limited resources.
Google Research Blog
© TechCrunch AIOpen Sourceagents
Microsoft Introduces Agent Control Specification for AI
Microsoft's new Agent Control Specification (ACS) offers developers a unified way to manage AI agent behavior across various environments. By allowing teams to define specific policies, ACS ensures agents operate within set boundaries, reducing the risk of unintended actions. This open-source standard integrates controls into a common governance layer, making it easier to audit and reuse across different systems. With ACS, developers can maintain consistent oversight, enhancing both security and compliance in AI deployments.
TechCrunch AI
Open Sourcemodels
llama.cpp b9467 Release Expands Platform Support
The latest b9467 release of llama.cpp continues its trend of broadening platform compatibility, notably adding support for ROCm 7.2 on Ubuntu x64. This update ensures that AMD GPU users can leverage llama.cpp more effectively, narrowing the performance gap with NVIDIA's CUDA. While some features like KleidiAI on macOS Apple Silicon remain disabled, the release still marks a significant step in making llama.cpp a versatile tool across diverse hardware configurations. The focus remains on expanding accessibility, though no new model architectures are introduced in this update.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9439 release expands platform support
The b9439 release of llama.cpp continues its trend of broadening platform compatibility, though this update is more about refinement than groundbreaking changes. Notably, the release includes support for ROCm 7.2 on Ubuntu x64, which is significant for AMD GPU users seeking alternatives to NVIDIA's CUDA. While some features like KleidiAI on macOS and SYCL on Windows remain disabled, the release still marks a step forward in making llama.cpp a versatile tool across diverse hardware environments. This update doesn't introduce new models but solidifies llama.cpp's role as a flexible inference runtime.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9441 Release Expands Platform Support
The b9441 release of llama.cpp continues its trend of broadening platform compatibility, though with some notable exceptions. While macOS Apple Silicon users see KleidiAI support disabled, the release adds Vulkan support for Ubuntu and Windows, and introduces ROCm 7.2 for Ubuntu x64, enhancing AMD GPU usability. The update also includes CUDA 12 and 13 DLLs for Windows, ensuring compatibility with the latest NVIDIA technologies. This release demonstrates llama.cpp's commitment to being a versatile inference runtime across diverse hardware, though some features remain disabled, indicating ongoing development challenges.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9444 Release Expands Platform Support
The b9444 release of llama.cpp enhances its reach by supporting a broader range of systems, including macOS, Linux, Windows, and openEuler. A significant addition is the ROCm 7.2 support on Ubuntu x64, which offers AMD GPU users a viable alternative to NVIDIA's CUDA. Although features like KleidiAI on macOS and SYCL on Windows are not yet active, the update emphasizes llama.cpp's role as a flexible inference runtime across different hardware configurations. While no new models are introduced, the release focuses on strengthening the existing infrastructure, making it more accessible for developers working on diverse hardware setups.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9428 Release Enhances Platform Support
The b9428 release of llama.cpp significantly enhances its platform support, addressing key issues and expanding compatibility. This update fixes the s390x release job and introduces multi-thread build capabilities for iOS-Xcode, improving performance. It also broadens support for macOS, Linux, and Windows, with specific enhancements like Vulkan and ROCm 7.2 on Ubuntu, and CUDA on Windows. While some features like KleidiAI on macOS remain disabled, the release demonstrates a commitment to making llama.cpp more accessible and versatile for developers working across different systems.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9430 Release Adds LSX Support
The latest b9430 release of llama.cpp introduces LSX support, optimizing performance for LoongArch architectures. By implementing native intrinsics for fp16 load/store operations and adding LSX implementations for various dot products, the update enhances computational efficiency. This release also includes improvements for macOS, Linux, and Windows platforms, with specific enhancements for Apple Silicon and Vulkan support. While some features remain disabled, the update signifies a step forward in making llama.cpp more versatile across different hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9431 Release Updates macOS and Windows Builds
The b9431 release of llama.cpp brings targeted updates to its build processes, particularly enhancing the iOS-Xcode release job by moving to macOS-26. This update also involves disabling the libcommon build from the xcframework, which may indicate a strategic optimization. On the Windows side, the release includes updates for CUDA 12 and CUDA 13 DLLs, ensuring the software remains compatible with the latest GPU advancements. While no new features are introduced, these changes reflect a commitment to refining performance and maintaining compatibility with current technologies across different operating systems.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9432 Release Expands Platform Support
The b9432 release of llama.cpp continues its trend of broadening platform compatibility, notably adding support for ROCm 7.2 on Ubuntu x64. This update ensures that AMD GPU users can leverage llama.cpp more effectively, narrowing the gap with NVIDIA's CUDA. While some features like KleidiAI on macOS and SYCL on Windows remain disabled, the release still marks a significant step in making llama.cpp a versatile tool across diverse systems. The focus remains on expanding accessibility and performance across different hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9433 release expands platform support
The latest b9433 release of llama.cpp continues its trend of broadening platform compatibility, notably adding support for ROCm 7.2 on Ubuntu x64. This update ensures that AMD GPU users can leverage llama.cpp more effectively, narrowing the gap with NVIDIA's CUDA. While some features like KleidiAI on macOS Apple Silicon remain disabled, the release still marks a significant step in making llama.cpp a versatile tool across diverse systems. The focus remains on expanding accessibility and performance across various hardware configurations, making it a more inclusive choice for developers.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9436 release expands platform support
The b9436 release of llama.cpp continues to broaden its platform compatibility, though some features remain unavailable. MacOS Apple Silicon users will notice that KleidiAI support is disabled, while Ubuntu users benefit from the inclusion of ROCm 7.2 and Vulkan support. Windows users gain enhanced GPU performance options with the addition of CUDA 12 and 13 DLLs. Despite some features like SYCL on Windows and macOS being disabled, the release focuses on making llama.cpp a versatile inference runtime across various systems. This update doesn't introduce new models but refines existing platform support, making it more adaptable for developers.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9437 release enhances platform support
The b9437 release of llama.cpp introduces significant improvements in platform compatibility and user experience. By setting the default value of -ngl to -1, it ensures consistency with other tools, simplifying the setup process for users. This update extends support to a wide range of systems, including macOS with Apple Silicon, Linux with Vulkan, and Windows with CUDA 12 and 13. Although features like KleidiAI on macOS and SYCL on Windows are currently disabled, the release continues to enhance the tool's reach. These changes make llama.cpp a more adaptable and user-friendly option for developers working across different environments.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9389 Release Expands Platform Support
The latest b9389 release of llama.cpp continues its trend of broadening platform compatibility, though with some notable exceptions. While macOS Apple Silicon users see KleidiAI support disabled, the release strengthens its Linux offerings with ROCm 7.2 and Vulkan support. Windows users benefit from updated CUDA DLLs, enhancing performance for CUDA 12 and 13. This release demonstrates llama.cpp's commitment to being a versatile inference runtime across diverse hardware, though some features remain disabled, indicating ongoing development challenges.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9391 release expands platform support
The b9391 release of llama.cpp continues to broaden its platform support, making it more accessible to a diverse range of users. Notably, this update includes support for Ubuntu x64 with ROCm 7.2, which is significant for AMD GPU users seeking alternatives to NVIDIA's CUDA. While some features like KleidiAI on macOS Apple Silicon and SYCL FP32 on Ubuntu are disabled, the release still marks a step forward in making llama.cpp a versatile tool across different operating systems. This update doesn't introduce new models but enhances the existing infrastructure, ensuring more users can leverage llama.cpp's capabilities.
llama.cpp Releases
Open Sourcecoding
Llama.cpp b9393 Release Fixes Audio RMS Norm
The b9393 release of llama.cpp resolves a critical issue with the audio RMS norm in the gemma 4 module, enhancing its stability. This update, with contributions from Sigbjørn Skjæret, impacts a wide array of systems, including macOS, Linux, Windows, and openEuler. It continues to support architectures like Apple Silicon, Vulkan, and ROCm on Ubuntu, ensuring developers can rely on it across different environments. While it doesn't introduce new features, the update focuses on improving performance and compatibility, reinforcing llama.cpp's position as a reliable tool for developers working with diverse hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9395 Release Expands Platform Support
The b9395 release of llama.cpp continues its trend of broadening platform compatibility, though with some notable exceptions. While macOS Apple Silicon users see KleidiAI support disabled, the release strengthens its Linux offerings with Vulkan and ROCm 7.2 support on Ubuntu. Windows users benefit from CUDA 12 and 13 DLLs, enhancing GPU performance. However, some features like SYCL support remain inactive on certain systems. This update underscores llama.cpp's commitment to being a versatile inference runtime, though it still has gaps to fill in its platform support.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9400 Release Expands Platform Support
The b9400 release of llama.cpp continues its trend of broadening platform compatibility, though without major new features. Notably, it includes support for ROCm 7.2 on Ubuntu x64, which is significant for AMD GPU users seeking alternatives to NVIDIA's CUDA. The release also maintains a wide array of builds across macOS, Linux, Windows, and openEuler, though some configurations like KleidiAI on macOS and SYCL on Windows remain disabled. This update reinforces llama.cpp's role as a versatile inference runtime, though it doesn't introduce groundbreaking changes.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9331 Release Enhances CI Workflows
The b9331 release of llama.cpp brings a strategic overhaul to its continuous integration workflows, focusing on efficiency by isolating tasks into separate workflows. This update includes the extraction of Android and HIP tasks, alongside the relocation of WebGPU and RPC tasks into distinct workflows. Additionally, the release halts SYCL f16 builds and optimizes pull request jobs by aligning backend paths. While there are no new model architectures introduced, this release aims to streamline development processes and enhance build management across diverse environments.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9333 release expands platform support
The b9333 release of llama.cpp marks a significant expansion in its platform reach, enhancing its utility across various systems. With this update, macOS Apple Silicon users can now leverage KleidiAI, while Ubuntu users benefit from Vulkan and ROCm 7.2 enhancements. Windows compatibility is also improved with the inclusion of CUDA 12 and 13 DLLs, and openEuler architectures are now part of the supported lineup. Although there are no new model architectures in this release, llama.cpp is becoming a more versatile inference runtime, catering to a broader range of hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9351 Release Expands Platform Support
The b9351 release of llama.cpp continues to broaden its platform compatibility, notably integrating ROCm 7.2 on Ubuntu x64, which enhances performance for AMD GPU users. This update also includes KleidiAI support for macOS Apple Silicon, making it easier for developers on M-series Macs to leverage ARM-tuned capabilities. While some features like SYCL FP32 on Ubuntu and Windows remain disabled, the release highlights llama.cpp's commitment to being a versatile inference runtime across diverse systems. This update doesn't introduce new models but strengthens the infrastructure for existing ones.
llama.cpp Releases
© Hugging Face BlogOpen Sourceagents
Reachy Mini Enables Local Speech Processing
Hugging Face has introduced a fully local speech processing setup for the Reachy Mini robot, eliminating the need for cloud services and enhancing privacy. By utilizing a cascaded voice pipeline, users can run speech-to-speech interactions entirely on their own hardware, ensuring that no data leaves their network. This setup leverages components like llama.cpp for LLM and Parakeet-TDT for STT, allowing for customizable and cost-effective speech processing. The move empowers users with full control over their speech processing pipeline, offering flexibility to swap components as new models become available.
Hugging Face Blog
Open Sourcemodels
llama.cpp b9296 Release Expands Platform Support
The latest b9296 release of llama.cpp continues its trend of broadening platform compatibility, making it a versatile tool for developers across various systems. Notably, this update includes support for macOS Apple Silicon with KleidiAI enabled, and expands its reach on Windows with CUDA 12 and 13 DLLs. The inclusion of ROCm 7.2 for Ubuntu x64 further enhances its utility for AMD GPU users. While there are no groundbreaking new features, the release solidifies llama.cpp's position as a go-to runtime for diverse hardware configurations, ensuring developers can leverage its capabilities across a wide array of environments.
llama.cpp Releases
Open Sourcecoding
llama.cpp b9283 Release Fixes Build Issues
The b9283 release of llama.cpp tackles significant build issues, particularly enhancing support for Apple systems and ensuring proper installation of implementation libraries. By adding install functionality for shared libraries, the update prevents runtime errors that previously disrupted operations. Developers using macOS, Windows, and Linux can now expect more reliable performance, with specific improvements for Apple Silicon and KleidiAI. The update also addresses issues with CUDA and ROCm builds, reinforcing llama.cpp's stability. While no new features are introduced, this release is a crucial step in refining the software's cross-environment functionality.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9284 Release Enhances Compatibility
The b9284 release of llama.cpp brings significant improvements to its compatibility and performance across different systems. With ROCm 7.2 now supported on Ubuntu x64, AMD GPU users can expect better performance. The update also resolves potential token collisions in the HybridDNA tokenizer, ensuring smoother text processing. On macOS Apple Silicon, KleidiAI is enabled by default, offering optimized performance without additional configuration. While no new models are introduced, the release strengthens llama.cpp's role as a versatile inference runtime, accommodating a wide range of operating environments.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9289 Release Expands Platform Support
The b9289 release of llama.cpp marks a significant step in broadening its platform reach, making it more accessible for developers working on various systems. This update includes support for macOS Apple Silicon with KleidiAI enabled, enhancing performance on Apple's hardware. Windows users benefit from the addition of CUDA 12 and 13 DLLs, while Vulkan support is now available on both Ubuntu and Windows. The inclusion of ROCm 7.2 for Ubuntu caters to AMD users, offering more flexibility in hardware choices. By extending its compatibility, llama.cpp is becoming a more versatile tool for developers aiming to implement AI solutions across different operating systems.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9292 Release Expands Platform Support
The latest b9292 release of llama.cpp significantly broadens its platform compatibility, making it more accessible to a diverse range of users. With support now extended to macOS Apple Silicon with KleidiAI, Ubuntu with ROCm 7.2, and Windows with CUDA 12 and 13, developers can leverage llama.cpp across more environments than ever before. This update doesn't introduce new models or features but focuses on ensuring that the existing capabilities are available on a wider array of hardware and operating systems. By doing so, llama.cpp continues to position itself as a versatile tool for developers working with AI inference across different platforms.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9294 Release Expands Platform Support
The b9294 release of llama.cpp marks a significant step in broadening its reach across various systems. With the addition of macOS Apple Silicon support, including KleidiAI, and Ubuntu with ROCm 7.2, developers can now utilize llama.cpp's capabilities on a wider array of hardware. Windows users benefit from the inclusion of CUDA 13 support, enhancing performance for NVIDIA GPU users. The update also introduces Vulkan and SYCL support, making it a versatile tool for AI inference. While no new models are introduced, this release focuses on making llama.cpp more accessible and efficient across different hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9273 Release Expands Platform Support
The b9273 release of llama.cpp marks a significant step in broadening its reach, now supporting a wider array of systems. Developers using macOS Apple Silicon can now benefit from KleidiAI, while Ubuntu users gain access to ROCm 7.2, enhancing GPU performance. Windows developers aren't left out, with new support for CUDA 12 and 13, making it easier to integrate llama.cpp into existing workflows. Although no new models are introduced, the focus on improving the runtime environment makes it a more adaptable tool for AI inference. This release underscores llama.cpp's commitment to being a versatile solution for developers seeking robust AI capabilities.
llama.cpp Releases
© GitHub ChangelogOpen Sourcecoding
GitHub Copilot for Eclipse Goes Open Source
GitHub has open-sourced its Copilot plugin for Eclipse, marking a significant step in integrating AI-powered tools within the Eclipse ecosystem. By releasing the code under the MIT license, GitHub invites developers to explore, contribute, and innovate on how AI enhances developer experiences in Eclipse. This move not only promotes transparency but also encourages community-driven development, allowing developers to understand and influence the plugin's functionality. With the source code available, developers can now delve into the mechanics of Copilot's features like code completion and agentic workflows, fostering a collaborative environment for future enhancements.
GitHub Changelog
Open Sourcemodels
llama.cpp b9251 Release Expands Platform Support
The b9251 release of llama.cpp marks a significant expansion in its platform capabilities, particularly for macOS Apple Silicon users with KleidiAI now enabled by default. Developers will find enhanced support for Vulkan and ROCm 7.2 on Ubuntu, broadening the tool's applicability across different systems. This update also brings technical refinements such as the addition of ggml_backend_dev_t and a new debug log feature, which improve performance and troubleshooting. While no new models are introduced, the renaming of alloc_compute_meta to reserve_compute_meta and the removal of unused functions streamline the codebase. This release reinforces llama.cpp's role as a versatile tool for developers working with diverse hardware configurations.
llama.cpp Releases
Open Sourcecoding
Llama.cpp b9257 Release Optimizes Vulkan Shader
The b9257 release of llama.cpp enhances the IM2COL shader for Vulkan, boosting performance for developers leveraging this graphics API. This update also refines the codebase with better formatting and additional comments, making it more developer-friendly. With compatibility across platforms like macOS, Linux, Windows, and Android, developers on various systems can take advantage of these improvements. Although there are no new groundbreaking features, the focus on performance optimization and code clarity represents a meaningful progression for the llama.cpp project.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9240 Release Expands Platform Support
The latest b9240 release of llama.cpp continues its trend of broadening platform compatibility, now including support for macOS Apple Silicon with KleidiAI enabled, and expanding Vulkan support across Ubuntu and Windows. This release also integrates ROCm 7.2 for Ubuntu, enhancing performance for AMD GPU users. By adding CUDA 12 and 13 support on Windows, llama.cpp ensures that developers can leverage the latest NVIDIA technologies. This update solidifies llama.cpp's position as a versatile inference runtime across diverse hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9245 Release Expands Platform Support
The latest b9245 release of llama.cpp significantly broadens its platform compatibility, making it more accessible to a diverse range of users. With new builds for macOS, Linux, Windows, and Android, the update includes support for Apple Silicon, Vulkan, ROCm 7.2, and CUDA 13, among others. This expansion means developers can now leverage llama.cpp's capabilities across more environments, enhancing its utility for AI inference tasks. While no new models or quantization methods are introduced, the focus on platform inclusivity marks a notable step forward in making llama.cpp a versatile tool for developers.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9213 Release Expands Platform Support
The latest b9213 release of llama.cpp significantly enhances its reach by supporting a wider array of systems. It now includes macOS Apple Silicon with KleidiAI enabled, alongside configurations for Ubuntu, Windows, and Android. This update also brings Vulkan support to both Ubuntu and Windows, and strengthens compatibility with ROCm 7.2 on Ubuntu, making it more versatile for developers. By accommodating more hardware and software environments, llama.cpp continues to evolve as a flexible tool for those working with AI models.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9219 Release Expands Platform Support
The latest b9219 release of llama.cpp continues its trend of broadening platform compatibility, now including support for macOS Apple Silicon with KleidiAI enabled and a variety of Linux configurations such as Ubuntu with ROCm 7.2 and Vulkan. This update also enhances Windows support with CUDA 12 and 13 DLLs, making it more versatile for developers working across different systems. While there are no groundbreaking new features, the release solidifies llama.cpp's position as a flexible inference runtime for diverse hardware setups. Developers can now leverage these updates to optimize AI model performance across a wider range of devices.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9194 Release Expands Platform Support
The latest b9194 release of llama.cpp continues its trend of broadening platform compatibility, now including support for macOS Apple Silicon with KleidiAI enabled and a variety of Linux and Windows configurations. Notably, it adds Vulkan support for Ubuntu and Windows, as well as ROCm 7.2 for Ubuntu, which is significant for AMD GPU users. This release doesn't introduce new models but focuses on making llama.cpp a versatile tool across different hardware setups. The update is a step forward in ensuring that developers can leverage llama.cpp's capabilities on a wider range of systems without compatibility issues.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9196 Release Expands Platform Support
The b9196 release of llama.cpp marks a significant step in broadening its reach across different hardware environments. With the inclusion of macOS Apple Silicon support, now featuring KleidiAI, and enhanced Vulkan and ROCm 7.2 support on Ubuntu, the update ensures developers have more flexibility. Windows users benefit from the addition of CUDA 12 and 13 support, making it easier to run llama.cpp on NVIDIA hardware. Although no new models are introduced, the focus on expanding runtime compatibility highlights llama.cpp's commitment to being a versatile tool for AI inference. This release makes llama.cpp more accessible to developers working across a variety of systems, reinforcing its role as a go-to inference runtime.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9197 Release Expands Platform Support
The b9197 release of llama.cpp marks another step in broadening its platform compatibility, making it an adaptable choice for developers. This update introduces support for macOS Apple Silicon with KleidiAI enabled, alongside enhanced Vulkan and ROCm 7.2 support on Ubuntu. Windows users gain from the inclusion of CUDA 12 and 13 DLLs, which boost GPU performance. Although no new models are added, the release reinforces llama.cpp's role as a flexible inference runtime, accommodating diverse hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9202 Release Expands Platform Support
The b9202 release of llama.cpp marks a significant step in broadening its reach across different systems. With new support for macOS Apple Silicon featuring KleidiAI, and Vulkan compatibility for both Ubuntu and Windows, developers have more flexibility than ever. The inclusion of ROCm 7.2 for Ubuntu enhances performance for those using AMD GPUs, making it a noteworthy update. While no new model architectures are introduced, the focus on expanding runtime compatibility ensures that llama.cpp can be utilized effectively by a wider range of developers. This release is about making llama.cpp a more versatile tool, accommodating the needs of developers working in diverse computing environments.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9203 Release Expands Platform Support
The b9203 release of llama.cpp enhances its platform compatibility, now supporting systems across macOS, Linux, Windows, and Android. This update introduces Vulkan support for both Ubuntu and Windows, which boosts graphics processing capabilities. The addition of ROCm 7.2 for Ubuntu x64 is a significant improvement for AMD GPU users, offering more flexibility for local inference. While no new models are introduced, this release focuses on making llama.cpp a more adaptable tool across different hardware configurations, ensuring developers have the resources they need for diverse environments.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9181 Release Expands Platform Support
The b9181 release of llama.cpp marks a significant step in enhancing its compatibility across multiple platforms. Apple Silicon users now have access to KleidiAI-enabled builds, while Windows users can leverage the latest CUDA 12 and 13 support. Ubuntu x64 users benefit from the inclusion of ROCm 7.2, which improves performance for AMD GPUs. Although this update doesn't introduce new models, it focuses on making llama.cpp a more adaptable tool for developers working with different hardware and software environments.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9186 Release Expands Platform Support
The latest b9186 release of llama.cpp continues its trend of broadening platform compatibility, now including support for macOS Apple Silicon with KleidiAI enabled, and a variety of Linux configurations such as Ubuntu with Vulkan and ROCm 7.2. This update also enhances Windows support with CUDA 12 and 13 DLLs, making it more versatile for developers working across different environments. While there are no groundbreaking new features, the release solidifies llama.cpp's position as a flexible inference runtime for diverse hardware setups. Developers can now leverage these updates to optimize AI model performance across a wider range of systems.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9189 Release Expands Platform Support
The b9189 release of llama.cpp significantly enhances its reach by supporting more platforms, including macOS, Linux, and Windows. This update introduces KleidiAI support on macOS Apple Silicon, while also expanding Vulkan and ROCm 7.2 capabilities on Ubuntu. Although no new models are introduced, the focus is on improving the runtime environment for developers using diverse hardware setups. By broadening its compatibility, llama.cpp strengthens its position as a flexible tool for AI inference, catering to developers across different systems and use cases.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9190 Release Expands Platform Support
The latest b9190 release of llama.cpp significantly broadens its platform compatibility, making it more accessible for developers across various systems. With new support for macOS Apple Silicon, Ubuntu with ROCm 7.2, and Windows with CUDA 12 and 13, this update ensures that developers can leverage llama.cpp's capabilities on a wider range of hardware. This release doesn't introduce new models but focuses on enhancing the runtime environment, making it a more versatile tool for AI inference. Developers now have more flexibility in choosing their preferred platforms without compromising on performance.
llama.cpp Releases
Open Sourcecoding
llama.cpp b9161 Release Enhances Codex CLI Support
The b9161 release of llama.cpp brings a significant improvement to the Codex CLI by bypassing unsupported Responses tools, which enhances its functionality across different operating systems. This update includes warnings for any skipped tools and reverts the special handling for gpt-oss apply_patch, ensuring smoother operations. With support for macOS, Linux, and Windows, including specific builds like macOS Apple Silicon with KleidiAI and Ubuntu with ROCm 7.2, the release broadens its reach. Windows users benefit from CUDA 12 and CUDA 13 support, making it more versatile. While no new models are introduced, the focus on refining existing capabilities makes llama.cpp more robust and reliable for developers.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9163 Release Expands Platform Support
The b9163 release of llama.cpp marks a significant step in broadening its reach across different hardware environments. With new support for macOS Apple Silicon featuring KleidiAI, and Windows systems now accommodating CUDA 12 and 13 DLLs, developers gain enhanced flexibility. The addition of Vulkan support on both Ubuntu and Windows platforms promises improved performance for users. While no new model architectures are introduced, this update focuses on making llama.cpp a more adaptable tool for developers working with diverse hardware setups.
llama.cpp Releases
Open Sourcecoding
llama.cpp b9169 Release Enhances Compatibility
The b9169 release of llama.cpp brings a series of technical improvements, notably adding chunks and fixing preprocessing for qwen3a. This update also addresses memory management by limiting mtmd_chunk size, preventing excessive memory use. Audio token handling has been corrected, and the set_input case has been re-ordered for better processing. With expanded support for macOS, Linux, and Windows, including KleidiAI on Apple Silicon and ROCm 7.2 on Ubuntu, this release optimizes performance across various systems. While it doesn't introduce new groundbreaking features, these refinements make llama.cpp more robust and adaptable for developers working in diverse computing environments.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9172 Release Expands Platform Support
The latest b9172 release of llama.cpp continues its trend of broadening platform compatibility, now including support for systems ranging from macOS Apple Silicon to Windows with CUDA 13. This update is significant for developers working across diverse environments, as it ensures that llama.cpp can be utilized on nearly any hardware configuration. Notably, the inclusion of ROCm 7.2 for Ubuntu x64 and Vulkan support on various operating systems highlights a commitment to making AI inference more accessible. While there are no groundbreaking new features, this release solidifies llama.cpp's position as a versatile tool for AI developers.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9173 Release Expands Platform Support
The latest b9173 release of llama.cpp continues its trend of broadening platform compatibility, now including support for macOS Apple Silicon with KleidiAI enabled and a variety of Linux configurations such as Ubuntu with ROCm 7.2 and Vulkan. This update also enhances Windows support with CUDA 12 and 13 DLLs, making it more versatile for developers working across different environments. While there are no groundbreaking new features, the release solidifies llama.cpp's position as a flexible inference runtime across diverse hardware setups. Developers can now leverage these updates to optimize performance on their specific systems.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9150 Release Expands Platform Support
The b9150 release of llama.cpp continues its trend of broadening platform compatibility, now including support for macOS Apple Silicon with KleidiAI enabled and a variety of Linux configurations such as Ubuntu with ROCm 7.2 and Vulkan. This update also enhances Windows support with CUDA 12 and 13 DLLs, making it more versatile for developers working across different environments. While there are no groundbreaking new features, the release solidifies llama.cpp's position as a flexible inference runtime for diverse hardware setups. Developers can now leverage these updates to optimize performance across a wider range of systems.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9159 Release Expands Platform Support
The latest b9159 release of llama.cpp significantly broadens its platform compatibility, making it more accessible to a diverse range of users. With new builds for macOS, Linux, Windows, and Android, the update includes support for Apple Silicon, Vulkan, ROCm 7.2, and CUDA 13. This expansion means developers can now leverage llama.cpp across more environments, enhancing its utility for AI inference tasks. While there are no new model architectures, the focus on platform diversity ensures that llama.cpp remains a versatile tool for developers working with different hardware configurations.
llama.cpp Releases
© TechCrunch AIOpen Sourcecoding
Clawdmeter: Open Source Dashboard for Claude Code Usage
Clawdmeter is an innovative open source project that turns Claude Code usage statistics into a playful desktop dashboard. Developed by Hermann Haraldsson, this device uses a Bluetooth-connected display to present pixel-art animations alongside token usage data, offering a nostalgic nod to classic hardware gadgets. With over 800 stars on GitHub, Clawdmeter captures the developer community's fascination with tokenmaxxing and the creative potential of AI tools. The project exemplifies how AI can make programming more accessible, enabling even those without embedded development experience to create engaging devices.
TechCrunch AI
Open Sourcecoding
llama.cpp b9129 Release Enhances CPU Fallback
The b9129 release of llama.cpp introduces an adaptive fallback feature for the ggml-zendnn backend, which optimizes performance by switching to the CPU for small batch sizes. This feature is enabled by default, but developers can control it using a new runtime environment variable, allowing them to revert to the original fallback logic if desired. The update supports platforms like macOS with KleidiAI, Windows with CUDA 12 and 13, and Ubuntu with ROCm 7.2, ensuring efficient processing across different systems. This release highlights llama.cpp's focus on enhancing performance and flexibility for developers working with various hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9134 Release Expands Platform Support
The latest b9134 release of llama.cpp continues its trend of broadening platform compatibility, making it a versatile tool for developers across various systems. This update includes support for macOS Apple Silicon with KleidiAI enabled, as well as expanded Vulkan and ROCm 7.2 support on Ubuntu. Windows users benefit from updated CUDA 12 and 13 DLLs, enhancing performance for GPU tasks. While no new models are introduced, the release solidifies llama.cpp's position as a flexible inference runtime across diverse hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9139 Release Expands Platform Support
The b9139 release of llama.cpp continues to enhance its platform reach, now supporting macOS Apple Silicon with KleidiAI enabled and various Linux distributions featuring Vulkan and ROCm 7.2. Windows users gain from the inclusion of CUDA 12 and 13 DLLs, improving compatibility for developers working with different hardware setups. While this update doesn't introduce groundbreaking features, it reinforces llama.cpp's role as a flexible inference runtime. Developers can now deploy llama.cpp across more systems, ensuring its capabilities are accessible to a broader developer base.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9140 Release Expands Platform Support
The latest b9140 release of llama.cpp significantly broadens its platform compatibility, making it more accessible for developers across various systems. With support for macOS Apple Silicon, Ubuntu with ROCm 7.2, and Windows with CUDA 12 and 13, this update ensures that developers can leverage llama.cpp's capabilities on a wider range of hardware. The inclusion of Vulkan and SYCL support further enhances its versatility, catering to both CPU and GPU users. This release doesn't introduce new models but focuses on making llama.cpp a more universal tool for AI inference across different hardware setups.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9144 Release Expands Platform Support
The b9144 release of llama.cpp enhances its adaptability by optimizing for specific hardware setups, particularly through the ggml-webgpu update. This ensures subgroup-matrix paths are utilized only when head dimensions meet certain divisibility conditions, improving efficiency. The release broadens support across macOS, Linux, Windows, and Android, with significant improvements for Apple Silicon, Vulkan, and CUDA environments. By focusing on these enhancements, llama.cpp strengthens its role as a flexible tool for developers working with a wide range of hardware configurations, even if no groundbreaking features are introduced.
llama.cpp Releases
© Microsoft ResearchOpen Sourcecoding
Microsoft's mimalloc: A Scalable Memory Allocator
Microsoft Research's mimalloc is a high-performance, scalable memory allocator designed to replace traditional malloc and free functions. It stands out with its compact codebase and efficient handling of memory allocation across multiple threads, making it ideal for modern applications with large memory demands. By using thread-local heaps, mimalloc minimizes synchronization needs, enhancing performance in concurrent environments. Its adoption in major services like Bing and integration into platforms like Unreal Engine highlight its effectiveness. This development marks a significant step in optimizing memory management for both small and large-scale applications.
Microsoft Research
Open Sourcemodels
llama.cpp b9118 Release Expands Platform Support
The latest b9118 release of llama.cpp continues its trend of broadening platform compatibility, now including support for a wide array of systems such as macOS, Linux, Windows, and Android. Notably, this update introduces Vulkan support on Ubuntu and Windows, alongside ROCm 7.2 for AMD GPUs, which is a significant step for users seeking alternatives to NVIDIA's CUDA. The inclusion of KleidiAI on Apple Silicon further enhances performance for M-series Macs. While there are no new model architectures, this release solidifies llama.cpp's position as a versatile inference runtime across diverse hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9124 Release Expands Platform Support
The latest b9124 release of llama.cpp enhances its versatility by broadening platform compatibility, making it more accessible for developers. By exposing modalities to the /v1/models endpoint, it allows for more adaptable model deployment. The update includes compatibility with various operating systems, from macOS Apple Silicon to Windows with CUDA 13, and even Ubuntu with ROCm 7.2. This release doesn't introduce new models but reinforces llama.cpp's role as a robust inference runtime across diverse hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9105 Release Enhances CUDA Integration
The b9105 release of llama.cpp brings a notable improvement by directly incorporating cuda/iterator, which enhances the reliability of CUDA operations. This update moves away from the previous reliance on a transient import from cub/cub.cuh, ensuring more stable performance for developers using NVIDIA GPUs. The release continues to support a broad array of platforms, including macOS with KleidiAI enabled, Linux with ROCm 7.2, and Windows with CUDA 12 and 13. While there are no new model architectures introduced, this update reinforces llama.cpp's role as a dependable tool for AI developers working across different hardware environments.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9094 Release Expands Platform Support
The b9094 release of llama.cpp marks a significant expansion in platform support, particularly for macOS and Windows users. With the inclusion of KleidiAI enabled builds for Apple Silicon, macOS users gain enhanced performance without additional configuration. Windows users benefit from the addition of CUDA 12 and 13 support, broadening the scope for GPU-accelerated tasks. This release doesn't introduce new models but focuses on making llama.cpp more accessible and versatile across a wider range of systems, reinforcing its position as a go-to inference runtime for diverse hardware setups.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9097 Release Expands Platform Support
The b9097 release of llama.cpp continues its trend of broadening platform compatibility, now including support for macOS Apple Silicon with KleidiAI enabled and various Linux configurations like Ubuntu with Vulkan and ROCm 7.2. This update also enhances Windows support with CUDA 12 and 13 DLLs, making it more versatile for developers working across different environments. While there are no groundbreaking new features, the release solidifies llama.cpp's position as a flexible inference runtime. Developers can now leverage these updates to optimize performance across a wider range of hardware setups.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9101 Release Expands Platform Support
The b9101 release of llama.cpp marks another step in expanding its platform compatibility, now covering macOS, Linux, Windows, and Android. This update introduces Vulkan support on both Ubuntu and Windows, alongside ROCm 7.2 on Ubuntu, enhancing GPU performance capabilities for developers. Windows users gain from the addition of CUDA 12 and 13 DLLs, which improve GPU utilization. While there are no revolutionary new features, this release reinforces llama.cpp's role as a versatile inference runtime across diverse hardware configurations, making it a reliable choice for developers working in varied environments.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9093 Release Expands Platform Support
The b9093 release of llama.cpp marks a significant step in broadening its platform compatibility, making it more accessible to a diverse range of users. With new builds for macOS, Linux, Windows, and Android, the update ensures that developers can leverage llama.cpp across various hardware configurations, including Apple Silicon, Intel, and ARM architectures. Notably, the addition of ROCm 7.2 for Ubuntu x64 and CUDA 12 and 13 for Windows x64 demonstrates a commitment to supporting both AMD and NVIDIA GPUs. This release doesn't introduce new models but focuses on making llama.cpp a versatile tool for developers working on different systems.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9073 Release Expands Platform Support
The b9073 release of llama.cpp marks a significant expansion in platform compatibility, enhancing its accessibility across various operating systems. With KleidiAI now enabled for macOS Apple Silicon, M-series Mac users can expect improved performance. The update also includes builds for Ubuntu featuring ROCm 7.2 and OpenVINO, alongside Windows versions with CUDA 12 and 13, reflecting a commitment to supporting diverse hardware. This positions llama.cpp as a versatile inference runtime, catering to developers across different environments without introducing new model architectures.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9079 Release Expands Platform Support
The latest b9079 release of llama.cpp continues its trend of broadening platform compatibility, now supporting a wide array of systems including macOS, Linux, Windows, and Android. Notably, it includes builds for macOS Apple Silicon with KleidiAI enabled, and Windows with CUDA 12 and 13 support, enhancing performance for NVIDIA GPU users. This release also introduces Vulkan and ROCm 7.2 support on Ubuntu, making it more versatile for developers working across different hardware configurations. While there are no new model architectures, the focus on expanding platform support ensures that llama.cpp remains a flexible and accessible tool for AI developers.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9081 Release Expands Platform Support
The latest b9081 release of llama.cpp continues its trend of broadening platform compatibility, making it a versatile choice for developers across different systems. Notably, this update includes support for macOS Apple Silicon with KleidiAI enabled, and expands Vulkan support to Ubuntu and Windows platforms. The addition of ROCm 7.2 for Ubuntu x64 users shows a commitment to AMD GPU users, while Windows users benefit from CUDA 12 and 13 support. This release doesn't introduce new models but solidifies llama.cpp's position as a flexible inference runtime across diverse hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9056 Release Expands Platform Support
The latest b9056 release of llama.cpp continues its trend of broadening platform compatibility, now including support for macOS Apple Silicon with KleidiAI enabled and a variety of Linux configurations such as Ubuntu with Vulkan and ROCm 7.2. This update also enhances Windows support with CUDA 12 and 13 DLLs, making it more versatile for developers working across different environments. While there are no groundbreaking new features, the release solidifies llama.cpp's position as a flexible inference runtime across diverse hardware setups. Developers can now leverage these updates to optimize performance on their specific systems, whether they're using Apple Silicon, AMD, or NVIDIA GPUs.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9057 Release Expands Platform Support
The latest b9057 release of llama.cpp continues its trend of broadening platform compatibility, now optimizing for RISC-V CPUs with q1_0 dot support. This update enhances performance across a wide array of systems, including macOS, Linux, Windows, and Android, with specific builds for Apple Silicon, Vulkan, and CUDA environments. Notably, the inclusion of ROCm 7.2 for Ubuntu x64 and CUDA 13 for Windows x64 signifies a commitment to supporting diverse hardware configurations. While no new models are introduced, this release solidifies llama.cpp's position as a versatile inference runtime across multiple architectures.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9058 Release Expands Platform Support
The b9058 release of llama.cpp significantly enhances its reach by supporting more platforms, making it a versatile tool for developers. It now includes KleidiAI support for macOS Apple Silicon, which optimizes performance on Apple's ARM architecture. The update also brings Vulkan support to both Ubuntu and Windows, boosting graphics processing capabilities. With the integration of ROCm 7.2 for Ubuntu, AMD GPU users see improved compatibility, narrowing the gap with NVIDIA. Additionally, Windows users benefit from CUDA 12 and 13 DLLs, catering to NVIDIA GPU needs. This release positions llama.cpp as a more adaptable solution for developers working with diverse hardware setups.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9062 Release Expands Platform Support
The latest b9062 release of llama.cpp continues its trend of broadening platform compatibility, making it a versatile tool for developers across various systems. Notably, this update includes support for macOS Apple Silicon with KleidiAI enabled, as well as expanded Vulkan and ROCm 7.2 support on Ubuntu. Windows users benefit from CUDA 12 and 13 compatibility, enhancing performance for those leveraging NVIDIA GPUs. This release doesn't introduce new models but solidifies llama.cpp's position as a go-to runtime for diverse hardware configurations, ensuring developers can deploy AI models efficiently across a wide array of environments.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9063 Release Expands Platform Support
The b9063 release of llama.cpp marks a significant step in broadening its compatibility across various systems. Notably, it now supports macOS Apple Silicon with KleidiAI enabled, Ubuntu with ROCm 7.2, and Windows with CUDA 13.1. While no new models are introduced, the update focuses on improving the runtime environment for different hardware setups, including Vulkan and SYCL support. This makes llama.cpp a more adaptable tool for developers working with diverse GPU and CPU architectures. By enhancing its functionality for both AMD and NVIDIA users, llama.cpp reinforces its position as a comprehensive inference runtime solution.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9064 Release Expands Platform Support
The latest b9064 release of llama.cpp continues its trend of broadening platform compatibility, making it a versatile choice for developers across different systems. With this update, Apple Silicon users benefit from KleidiAI integration, enhancing performance on M-series Macs. The inclusion of ROCm 7.2 for Ubuntu x64 further levels the playing field for AMD GPU users, while Windows users gain access to CUDA 12 and 13 support. This release doesn't introduce new models but solidifies llama.cpp's position as a go-to runtime for diverse hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9047 release focuses on device memory handling
The b9047 release of llama.cpp enhances how device memory is managed, particularly for GPUs with unknown configurations. By ensuring that memory fit for unknown GPUs is set to zero and maintaining a fallback for non-GPU devices, the update boosts stability and reliability. This release continues to support a broad array of operating systems, including macOS with KleidiAI enabled, Ubuntu with ROCm 7.2, and Windows with CUDA 12 and 13. While it doesn't introduce groundbreaking features, these refinements make llama.cpp a more dependable tool for developers working across different hardware environments.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9030 Release Expands Platform Support
The b9030 release of llama.cpp significantly enhances its platform reach, especially for macOS and Windows users. With KleidiAI now available for Apple Silicon, macOS users can enjoy improved performance without needing extra setup. Windows developers gain from the addition of CUDA 12 and 13, which facilitates better use of NVIDIA GPUs. This update doesn't bring new models but focuses on making llama.cpp more adaptable and functional across a broader array of systems, ensuring developers can utilize its features on their chosen platforms.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9015 Release Expands Platform Support
The b9015 release of llama.cpp marks another step in expanding its reach across diverse systems, now including macOS Apple Silicon with KleidiAI enabled and Ubuntu with ROCm 7.2. This update also brings Vulkan support to both Linux and Windows, enhancing the software's versatility. Windows users benefit from CUDA 12 and 13 support, ensuring compatibility with the latest NVIDIA technologies. While the release doesn't introduce new model architectures, it strengthens llama.cpp's role as a flexible inference runtime for developers working with varied hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9009 Release Expands Platform Support
The latest b9009 release of llama.cpp continues its trend of broadening platform compatibility, now including support for macOS Apple Silicon with KleidiAI enabled and various Linux distributions with Vulkan and ROCm 7.2. This update refines the server's efficiency by avoiding unnecessary checkpoint data host copies, which could enhance performance. While the release doesn't introduce new model architectures, it solidifies llama.cpp's position as a versatile inference runtime across diverse systems. Developers can now leverage these improvements to optimize AI applications on a wider range of hardware configurations.
llama.cpp Releases
Open Sourcecoding
b9014 Release Adds Layer Norm Ops to ggml-webgpu
The b9014 release of llama.cpp enhances ggml-webgpu by integrating layer normalization operations, boosting its shader functionality. This update stabilizes floating point computations with Kahan summation, though it later reverts to the original method for improved efficiency. By eliminating non-contiguous strides, the release optimizes performance on platforms like macOS with KleidiAI, Ubuntu with ROCm 7.2, and Windows with CUDA 12 and 13. These changes make llama.cpp more adaptable and efficient for developers working with a range of hardware setups.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9008 Release Expands Platform Support
The b9008 release of llama.cpp continues its trend of broadening platform support, making it a versatile tool for developers across various systems. This update includes new builds for macOS, Linux, Windows, and Android, with notable additions like Vulkan support on Ubuntu and Windows, and ROCm 7.2 on Ubuntu. By enhancing compatibility with different architectures, including Apple Silicon and Intel on macOS, and CUDA on Windows, llama.cpp is positioning itself as a go-to runtime for diverse hardware environments. While there are no groundbreaking new features, the release solidifies llama.cpp's role as a flexible and accessible inference tool for developers.
llama.cpp Releases
Open Sourceother
b9004 Release for Multiple Platforms
The b9004 release of llama.cpp introduces support for various platforms including macOS, Linux, Android, and Windows.
llama.cpp Releases
Open Sourceother
llama-quant update fixes tensor-type issue
The latest update for llama-quant addresses a tensor-type issue when the default qtype is overridden. This release includes support for various platforms.
llama.cpp Releases
Open Sourceother
New Vulkan Functions Added in Llama.cpp Release
The latest release of Llama.cpp introduces new Vulkan functions for tensor manipulation and updates across multiple platforms.
llama.cpp Releases
Open Sourceimage
vLLM Releases v0.18.2rc0 Update
The v0.18.2rc0 release includes a fix for handling the max_pixels parameter in the PaddleOCR-VL image processor across transformations.
vLLM Releases
Open Sourceother
New Release of llama.cpp Supports Multiple Platforms
The latest release of llama.cpp includes support for various operating systems and architectures, including macOS, Linux, Android, and Windows. This update enhances compatibility for developers working across different environments.
llama.cpp Releases
Open Sourceother
Llama.cpp Updates Hexagon Configuration Options
The latest release of Llama.cpp introduces configurable virtual memory and buffer sizes for Hexagon, along with various enhancements and support for multiple platforms including macOS, Linux, Android, and Windows.
llama.cpp Releases
Open Sourceother
Llama.cpp Updates Vocab Compatibility Checks
The latest release of Llama.cpp includes fixes for vocabulary compatibility checks in the spec example and updates to logging for draft and target model vocabulary mismatches. It supports multiple platforms including macOS, Linux, Android, and Windows.
llama.cpp Releases
© Together AI BlogOpen Sourceother
Aurora: Open-source RL Framework for Speculative Decoding
Aurora is an open-source reinforcement learning framework that enhances speculative decoding by allowing it to learn from each request it serves, rather than relying on a static setup.
Together AI Blog
© Google Research BlogOpen Sourceresearch
WAXAL: Open Resource for African Language Speech Tech
Google Research has introduced WAXAL, a large-scale open resource aimed at advancing speech technology for African languages. This initiative seeks to enhance natural language processing capabilities in underrepresented languages.
Google Research Blog
© Together AI BlogOpen Sourcecoding
CoderForge-Preview: New Open Dataset Released
Together AI has announced the release of CoderForge-Preview, a state-of-the-art open dataset designed for training efficient coding agents.
Together AI Blog
© Together AI BlogOpen Sourceother
Choosing the Right Open Model for Production
The article provides guidance on selecting open-source models for production by assessing model quality, performance benchmarks, and deployment considerations regarding cost, speed, and accuracy.
Together AI Blog
© Hugging Face BlogOpen Sourceresearch
Kimina-Prover-RL: New Open-Source Theorem Proving Pipeline
Kimina-Prover-RL introduces a novel open-source training pipeline for formal theorem proving in Lean 4, setting new benchmarks for open-source models. By employing a reasoning-then-generation paradigm, the pipeline enhances model explainability and error recovery. The release includes two models, AI-MO/Kimina-Prover-RL-1.7B and AI-MO/Kimina-Prover-RL-0.6B, which achieve state-of-the-art results on the MiniF2F benchmark. This development allows researchers to reproduce experiments and adapt the setup for their own models, marking a significant step forward in formal proof automation.
Hugging Face Blog
© Replicate BlogOpen Sourcevideo
Open source video model Wan 2.2 released
Replicate has announced Wan 2.2, their fastest and cheapest open source video model to date.
Replicate Blog
Open Sourceother
The Frontier is Open
Together AI has announced the opening of their new platform, allowing developers to access and utilize their AI tools more freely.
Together AI Blog
© EleutherAI BlogOpen Sourceresearch
Common Pile v0.1 Dataset Released
EleutherAI has announced the release of Common Pile v0.1, an 8TB dataset consisting of public domain and openly licensed text.
EleutherAI Blog
© Replicate BlogOpen Sourcevideo
Fine-tune open-source video models now available
Users can now train their own versions of Tencent's HunyuanVideo for style, motion, and character customization on the Replicate platform.
Replicate Blog
© Replicate BlogOpen Sourcemodels
FLUX fine-tunes optimization announced
Replicate has improved the speed of running fine-tunes for FLUX, and these optimizations are available as open-source.
Replicate Blog
© Replicate BlogOpen Sourceother
FLUX Optimizations Released as Open Source
FLUX has been optimized for speed on Replicate, and these improvements have been made available as open-source for further development.
Replicate Blog
© Replicate BlogOpen Sourceimage
New Open Source Image Model and Tools Released
Replicate has announced an open source frontier image model that allows users to cut objects from videos, along with a new Python web framework developed by Jeremy Howard.
Replicate Blog
© EleutherAI BlogOpen Sourceother
Open Source Pipeline for Auto-Interpretability Released
EleutherAI has announced the development of an open-source pipeline aimed at enhancing the interpretability of sparse autoencoder features.
EleutherAI Blog
© Replicate BlogOpen Sourceimage
Run Stable Diffusion 3 Locally with ComfyUI
Users can now run Stable Diffusion 3 on their own machines using ComfyUI by executing a few terminal commands. This allows for local experimentation with the model on GPU-powered systems.
Replicate Blog
© Replicate BlogOpen Sourceother
Replicate Intelligence #1 Overview
The Replicate Blog discusses a DIY implementation of Llama 3, introduces open-source smart glasses, and explores steering language models using dictionary learning techniques.
Replicate Blog
© Replicate BlogOpen Sourcemusic
Voice Cloning with Open-Source Models
Replicate has introduced fine-tuning for realistic voice cloning (RVC), allowing users to train models on their own datasets from YouTube videos using a simple code interface.
Replicate Blog
© EleutherAI BlogOpen Sourceother
Minetester: Open RL Environment on Minetest
Minetester is introduced as a fully open reinforcement learning environment built on the Minetest platform, along with an overview of its preliminary work.
EleutherAI Blog
© EleutherAI BlogOpen Sourceother
EleutherAI Yearly Retrospective Released
EleutherAI has published a detailed retrospective covering their activities over the past year.
EleutherAI Blog
© Hugging Face BlogOpen Sourcecoding
Hugging Face Introduces Skops for scikit-learn Models
Hugging Face has launched Skops, a new library designed to streamline the process of hosting scikit-learn models on the Hugging Face Hub. This tool allows developers to create detailed model cards, enhancing documentation and collaboration. By integrating Skops, users can easily serialize models, generate configuration files, and push them to the Hub, making them accessible for inference and further development. This release marks a significant step in making machine learning models more shareable and reproducible, particularly for those working with scikit-learn.
Hugging Face Blog
© EleutherAI BlogOpen Sourceother
Open Source Large Language Model for AI Safety
EleutherAI discusses the benefits of releasing a large language model as a means to enhance AI safety. The blog outlines their reasoning behind this belief.
EleutherAI Blog