Open Source
llama.cpp b9428 Release Enhances Platform Support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands platform compatibility, making llama.cpp more versatile for developers.
- →Fixes critical issues, improving the reliability of the release process.
- →Enhances performance with multi-thread build capabilities for iOS-Xcode.
The b9428 release of llama.cpp brings significant updates to its platform support, addressing issues and enhancing compatibility. Key improvements include a fix for the s390x release job and the introduction of multi-thread build capabilities for iOS-Xcode. The release also expands support for various configurations, such as Vulkan and ROCm 7.2 on Ubuntu, and CUDA on Windows. These updates aim to make llama.cpp more versatile and accessible for developers across different operating systems.
Read originalMore from llama.cpp Releases
Models & Labsmodels
Llama.cpp Update Fixes iGPU Device Selection
Llama.cpp has addressed a critical issue in its device selection logic that affected systems using integrated GPUs as their main compute device. Previously, the presence of any RPC server would cause the local iGPU to be ignored, leading to model loading failures. This update ensures that iGPUs are included unless no GPUs are available, allowing for proper tensor allocation and model loading on systems like the Strix Halo with significant unified memory. This fix enhances the reliability of llama.cpp on diverse hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9430 Release Adds LSX Support
The latest b9430 release of llama.cpp introduces LSX support, optimizing performance for LoongArch architectures. By implementing native intrinsics for fp16 load/store operations and adding LSX implementations for various dot products, the update enhances computational efficiency. This release also includes improvements for macOS, Linux, and Windows platforms, with specific enhancements for Apple Silicon and Vulkan support. While some features remain disabled, the update signifies a step forward in making llama.cpp more versatile across different hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9431 Release Updates macOS and Windows Builds
The b9431 release of llama.cpp brings targeted updates to its build processes, particularly enhancing the iOS-Xcode release job by moving to macOS-26. This update also involves disabling the libcommon build from the xcframework, which may indicate a strategic optimization. On the Windows side, the release includes updates for CUDA 12 and CUDA 13 DLLs, ensuring the software remains compatible with the latest GPU advancements. While no new features are introduced, these changes reflect a commitment to refining performance and maintaining compatibility with current technologies across different operating systems.
llama.cpp Releases
More in Open Source
© Lev SelectorOpen Sourcemodels
Cohere Command A+ Open Sourced
Cohere has open-sourced its Command A+ model, making it accessible for public use.
Lev Selector
© Hugging Face BlogOpen Sourceagents
Reachy Mini Enables Local Speech Processing
Hugging Face has introduced a fully local speech processing setup for the Reachy Mini robot, eliminating the need for cloud services and enhancing privacy. By utilizing a cascaded voice pipeline, users can run speech-to-speech interactions entirely on their own hardware, ensuring that no data leaves their network. This setup leverages components like llama.cpp for LLM and Parakeet-TDT for STT, allowing for customizable and cost-effective speech processing. The move empowers users with full control over their speech processing pipeline, offering flexibility to swap components as new models become available.
Hugging Face Blog
© Lev SelectorOpen Sourcemodels
Karpathy Open-Sources CLAUDE md
Andrej Karpathy has released CLAUDE md as open source.
Lev Selector