Models & Labs
New b8998 Release for Llama.cpp
llama.cpp Releasesmedium confidence
Why it matters
- →This release enhances cross-platform compatibility for developers. • It supports a wide range of architectures, improving accessibility. • The inclusion of GPU support options allows for better performance in AI applications.
The latest release of Llama.cpp, version b8998, has been announced, providing support for multiple operating systems. This update includes compatibility for macOS Apple Silicon, Intel, various Linux distributions, Android, and Windows with specific configurations for CPU and GPU support. Notably, it features enhancements for CUDA, Vulkan, and SYCL across different architectures. This release expands the accessibility of Llama.cpp for developers working on diverse platforms.
Read originalMore from llama.cpp Releases
Open Sourceother
llama-quant update fixes tensor-type issue
The latest update for llama-quant addresses a tensor-type issue when the default qtype is overridden. This release includes support for various platforms.
llama.cpp Releases
Models & Labsother
Vulkan Support Added in Llama.cpp Release
The latest Llama.cpp release introduces Vulkan support for asymmetric FA in the coopmat2 path, enhancing mixed quantization capabilities.
llama.cpp Releases
