Models & Labs
llama.cpp b10569 release enhances compatibility
llama.cpp Releaseshigh confidence
Why it matters
- →Enhances compatibility across multiple platforms, broadening developer access.
- →Improves performance with technical updates like dots3-note.
- →Supports CUDA 12 and 13, enhancing GPU compatibility on Windows.
The b10569 release of llama.cpp brings a series of technical updates aimed at improving performance and compatibility. Key changes include the addition of dots3-note and enhancements to the llama_kv_cache_dsa_iswa. The update supports a wide range of platforms, including macOS, Linux, and Windows, with specific enhancements for CUDA 12 and 13 on Windows. This release continues to build on llama.cpp's versatility, making it a more robust tool for developers across various systems.
Read originalMore from llama.cpp Releases
Models & Labsmodels
llama.cpp b10541 Release Adds New Features
The b10541 release of llama.cpp enhances developer flexibility with the introduction of the --mmproj-device argument, allowing for more nuanced control over device backends. This update also maintains compatibility with existing setups through the MTMD_BACKEND_DEVICE environment variable and introduces a convenient -mmdev shortflag. These improvements make it easier for developers to manage and load device backends efficiently. While there are no new model architectures in this release, the focus on refining usability ensures that developers can deploy their applications smoothly across different environments.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10545 Release Fixes Tensor API Bug
The latest release of llama.cpp, version b10545, addresses a critical bug in the Tensor API's mat-mat kernel. Previously, the kernel could read out-of-bounds elements when the K dimension wasn't a multiple of 32, leading to potential data corruption or NaN results. This update introduces a dynamic extent for K, ensuring that only valid data is processed, thus enhancing the reliability of matrix operations. This fix is crucial for developers relying on precise tensor computations, especially in environments where K-aligned inputs are not guaranteed.
llama.cpp Releases
Open Sourcemodels
llama.cpp b10566 Release Expands Platform Support
The b10566 release of llama.cpp focuses on broadening its reach across various architectures, though it doesn't bring any groundbreaking innovations. This update includes support for macOS, Linux, Windows, and openEuler, with some configurations like macOS Apple Silicon with KleidiAI and Ubuntu x64 with ROCm 7.14 being disabled. The release ensures that llama.cpp remains a versatile tool, offering Vulkan and OpenVINO support on different systems. While it doesn't introduce new features, it solidifies llama.cpp's role as a flexible inference runtime, accommodating a wide array of hardware environments.
llama.cpp Releases
More in Models & Labs
Models & Labsmodels
v0.28.0rc2: DFlash2 Local Convolution Update
The v0.28.0rc2 release of vLLM introduces DFlash2, a feature that enhances local convolution capabilities with a candidate selector. This update, cherry-picked from a specific commit, signifies a technical refinement aimed at improving model performance. While the specifics of the implementation are technical, the focus on local convolution suggests a targeted improvement in processing efficiency. This release is a step forward for developers looking to optimize their AI models with more precise convolution operations.
vLLM Releases
© Lev SelectorModels & Labsmodels
Qwen3.8-27B Model Released with MTP for Faster Performance
The Qwen3.8-27B model has been released, featuring MTP technology for enhanced speed and local operation capabilities.
Lev Selector
© Lev SelectorModels & Labsmodels
GLM-5.3 Outperforms Mythos 5 in Cybersecurity
The open-source model GLM-5.3 has surpassed Mythos 5 in cybersecurity performance, showcasing advancements in Chinese AI models.
Lev Selector