Open Source
llama.cpp b9518 release expands platform support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands support for AMD GPUs with ROCm 7.2, enhancing performance options.
- →Increases accessibility of llama.cpp across various operating systems and hardware.
- →Focuses on platform compatibility rather than new model features.
The latest b9518 release of llama.cpp has been announced, featuring expanded platform support. Key additions include ROCm 7.2 for Ubuntu x64, which benefits AMD GPU users. While certain features like KleidiAI on macOS remain disabled, the release provides a comprehensive range of builds for macOS, Linux, Windows, and openEuler. This update emphasizes llama.cpp's goal of being a versatile tool for AI inference across different hardware setups.
Read originalMore from llama.cpp Releases
Open Sourcecoding
llama.cpp b9503 release focuses on Gemma 4 fix
The b9503 release of llama.cpp addresses a technical issue with the Gemma 4 audio projector embedding size, enhancing its functionality. By removing the projection_dim from clip_n_mmproj_embd, the update streamlines the codebase. This release ensures better compatibility across macOS, Linux, and Windows, with specific builds for Apple Silicon, ROCm 7.2, and CUDA 12 and 13. While it doesn't introduce new features, the update reflects a commitment to improving the software's reliability and performance. This release is a technical refinement, focusing on stability rather than groundbreaking changes.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9504 release expands platform support
The b9504 release of llama.cpp continues to broaden its reach, enhancing compatibility across multiple environments. This update notably includes support for Ubuntu with ROCm 7.2, which boosts performance for AMD GPU users. While features like KleidiAI on macOS and SYCL on Windows are not yet active, the release still represents a significant step in making llama.cpp a more adaptable tool for developers. By focusing on expanding compatibility and improving the runtime experience, this update strengthens llama.cpp's position as a versatile option for developers working with different systems.
