Models & Labs
llama.cpp b9123 release enhances WebGPU support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands llama.cpp's capabilities with ggml-webgpu support for gpt-oss-20b.
- →Enhances performance optimization across multiple platforms.
- →Increases accessibility for developers with diverse hardware configurations.
The b9123 release of llama.cpp introduces support for running gpt-oss-20b using ggml-webgpu, enhancing its capabilities on various platforms. This update includes a refactor of the mulmat-q function and disables test-backend-ops in Ubuntu-24-webgpu, indicating a focus on performance optimization. The release supports a wide array of systems, from macOS and Linux to Windows and Android, with specific enhancements for Vulkan, ROCm, and CUDA environments. This positions llama.cpp as a versatile tool for developers deploying AI models across different hardware configurations.
Read originalMore from llama.cpp Releases
Models & Labsmodels
Llama.cpp b9116 Release Adds MiMo v2.5 Vision
The latest b9116 release of llama.cpp introduces MiMo v2.5, enhancing vision support with fused qkv for improved performance. This update addresses previous issues like f16 vision overflow and includes various cleanups for better code maintenance. With expanded platform support, including macOS, Linux, and Windows, this release broadens accessibility for developers working on diverse systems. The focus on vision capabilities marks a significant step in making llama.cpp a more versatile tool for AI developers, particularly those interested in integrating vision functionalities.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9118 Release Expands Platform Support
The latest b9118 release of llama.cpp continues its trend of broadening platform compatibility, now including support for a wide array of systems such as macOS, Linux, Windows, and Android. Notably, this update introduces Vulkan support on Ubuntu and Windows, alongside ROCm 7.2 for AMD GPUs, which is a significant step for users seeking alternatives to NVIDIA's CUDA. The inclusion of KleidiAI on Apple Silicon further enhances performance for M-series Macs. While there are no new model architectures, this release solidifies llama.cpp's position as a versatile inference runtime across diverse hardware configurations.
