Open Source
llama.cpp b9436 release expands platform support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands platform support, making llama.cpp more versatile.
- →Enhances GPU performance options for Windows users.
- →Focuses on refining existing capabilities rather than introducing new models.
The latest b9436 release of llama.cpp enhances its platform support, particularly for Ubuntu and Windows users. Ubuntu now includes ROCm 7.2 and Vulkan support, while Windows users gain from CUDA 12 and 13 DLLs, improving GPU performance. However, some features like KleidiAI on macOS and SYCL on Windows remain disabled. This release emphasizes llama.cpp's ongoing efforts to be a versatile inference runtime, despite not introducing new models.
Read originalMore from llama.cpp Releases
Models & Labsmodels
Llama.cpp Update Fixes iGPU Device Selection
Llama.cpp has addressed a critical issue in its device selection logic that affected systems using integrated GPUs as their main compute device. Previously, the presence of any RPC server would cause the local iGPU to be ignored, leading to model loading failures. This update ensures that iGPUs are included unless no GPUs are available, allowing for proper tensor allocation and model loading on systems like the Strix Halo with significant unified memory. This fix enhances the reliability of llama.cpp on diverse hardware configurations.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9428 Release Enhances Platform Support
The b9428 release of llama.cpp significantly enhances its platform support, addressing key issues and expanding compatibility. This update fixes the s390x release job and introduces multi-thread build capabilities for iOS-Xcode, improving performance. It also broadens support for macOS, Linux, and Windows, with specific enhancements like Vulkan and ROCm 7.2 on Ubuntu, and CUDA on Windows. While some features like KleidiAI on macOS remain disabled, the release demonstrates a commitment to making llama.cpp more accessible and versatile for developers working across different systems.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9430 Release Adds LSX Support
The latest b9430 release of llama.cpp introduces LSX support, optimizing performance for LoongArch architectures. By implementing native intrinsics for fp16 load/store operations and adding LSX implementations for various dot products, the update enhances computational efficiency. This release also includes improvements for macOS, Linux, and Windows platforms, with specific enhancements for Apple Silicon and Vulkan support. While some features remain disabled, the update signifies a step forward in making llama.cpp more versatile across different hardware configurations.
llama.cpp Releases
More in Open Source
© Lev SelectorOpen Sourcemodels
Cohere Command A+ Open Sourced
Cohere has open-sourced its Command A+ model, making it accessible for public use.
Lev Selector
© Hugging Face BlogOpen Sourceagents
Reachy Mini Enables Local Speech Processing
Hugging Face has introduced a fully local speech processing setup for the Reachy Mini robot, eliminating the need for cloud services and enhancing privacy. By utilizing a cascaded voice pipeline, users can run speech-to-speech interactions entirely on their own hardware, ensuring that no data leaves their network. This setup leverages components like llama.cpp for LLM and Parakeet-TDT for STT, allowing for customizable and cost-effective speech processing. The move empowers users with full control over their speech processing pipeline, offering flexibility to swap components as new models become available.
Hugging Face Blog
© Lev SelectorOpen Sourcemodels
Karpathy Open-Sources CLAUDE md
Andrej Karpathy has released CLAUDE md as open source.
Lev Selector