Models & Labs
b9119 release addresses Intel GPU performance
llama.cpp Releaseshigh confidence
Why it matters
- →Fixes a critical performance issue for Intel GPU users on Windows.
- →Ensures better efficiency by optimizing BF16 workload handling.
- →Reinforces llama.cpp's commitment to cross-platform performance improvements.
The latest b9119 release of llama.cpp addresses a performance regression issue on Windows for Intel GPU BF16 workloads, particularly affecting Xe2 and newer models. This update is crucial for users relying on Vulkan, as it restores expected performance levels. Additionally, the release includes a refactor to optimize the use of l_warptile, ensuring it is only used when coopamt is available for BF16. This release underscores llama.cpp's ongoing efforts to enhance performance across various hardware platforms.
Read originalMore from llama.cpp Releases
Models & Labsmodels
Llama.cpp adds GLM-5.2 speculative decoding support
Llama.cpp's latest update introduces speculative decoding support for GLM-5.2, enhancing its capabilities with NextN/MTP features. This addition allows for more efficient tensor loading and context management, particularly benefiting models using the GLM_DSA architecture. The update also includes options for exporting models with or without the MTP feature, providing flexibility for developers. This release marks a step forward in optimizing model performance and adaptability, especially for those leveraging the GLM-5.2 framework.
llama.cpp Releases
Open Sourcemodels
llama.cpp b10175 Release Expands Platform Support
The latest b10175 release of llama.cpp continues its trend of broadening platform compatibility, making it a versatile tool for developers across different systems. Notably, this update includes support for ROCm 7.2 on Ubuntu x64, which is significant for AMD GPU users seeking alternatives to NVIDIA's CUDA. The release also maintains a wide array of builds for Windows, macOS, and Linux, ensuring that developers can leverage llama.cpp's capabilities regardless of their hardware setup. While there are no groundbreaking new features, the consistent expansion of platform support solidifies llama.cpp's position as a flexible inference runtime option.
