Open Source
llama.cpp b9057 Release Expands Platform Support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands support for RISC-V CPUs, enhancing performance options.
- →Increases compatibility with diverse hardware, including Apple Silicon and CUDA.
- →Strengthens llama.cpp's position as a versatile inference runtime.
The b9057 release of llama.cpp introduces optimizations for RISC-V CPUs, enhancing its performance capabilities. This update includes support for a variety of platforms such as macOS, Linux, Windows, and Android, with specific builds for Apple Silicon, Vulkan, and CUDA environments. The addition of ROCm 7.2 for Ubuntu x64 and CUDA 13 for Windows x64 highlights its adaptability to different hardware configurations. This release does not feature new models but strengthens llama.cpp's role as a flexible inference runtime.
Read originalMore from llama.cpp Releases
Open Sourcemodels
llama.cpp b9056 Release Expands Platform Support
The latest b9056 release of llama.cpp continues its trend of broadening platform compatibility, now including support for macOS Apple Silicon with KleidiAI enabled and a variety of Linux configurations such as Ubuntu with Vulkan and ROCm 7.2. This update also enhances Windows support with CUDA 12 and 13 DLLs, making it more versatile for developers working across different environments. While there are no groundbreaking new features, the release solidifies llama.cpp's position as a flexible inference runtime across diverse hardware setups. Developers can now leverage these updates to optimize performance on their specific systems, whether they're using Apple Silicon, AMD, or NVIDIA GPUs.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9058 Release Expands Platform Support
The b9058 release of llama.cpp significantly enhances its reach by supporting more platforms, making it a versatile tool for developers. It now includes KleidiAI support for macOS Apple Silicon, which optimizes performance on Apple's ARM architecture. The update also brings Vulkan support to both Ubuntu and Windows, boosting graphics processing capabilities. With the integration of ROCm 7.2 for Ubuntu, AMD GPU users see improved compatibility, narrowing the gap with NVIDIA. Additionally, Windows users benefit from CUDA 12 and 13 DLLs, catering to NVIDIA GPU needs. This release positions llama.cpp as a more adaptable solution for developers working with diverse hardware setups.
llama.cpp Releases
Models & Labsmodels
llama.cpp b9060 Release Enhances SYCL Operations
The latest b9060 release of llama.cpp introduces several new SYCL operations, including FILL, CUMSUM, and DIAG, which expand the library's computational capabilities. This update also addresses a critical issue that caused aborts during test-backend-ops, ensuring more stable performance. With the addition of scope_dbg_print to both new and existing SYCL operations, developers gain enhanced debugging tools. This release continues to broaden llama.cpp's platform support, making it a more versatile tool for developers working across different environments.
llama.cpp Releases
More in Open Source
© Matt WolfeOpen Sourcemodels
DeepSeek V4 Offers Cost-Effective AI Solution
DeepSeek V4 is an open-source AI model offering near state-of-the-art capabilities at a significantly lower cost than competitors.
Matt Wolfe
Open Sourceimage
vLLM Releases v0.18.2rc0 Update
The v0.18.2rc0 release includes a fix for handling the max_pixels parameter in the PaddleOCR-VL image processor across transformations.
vLLM Releases
© Lev SelectorOpen Sourcecoding
Anthropic Launches 33 Open Source Plugins
Anthropic has released a suite of plugins that enhance the Claude ecosystem.
Lev Selector