Models & Labs
llama.cpp v0.3.0 Release
llama.cpp Releaseshigh confidence
Why it matters
- →The introduction of the dots3-note model expands multimodal capabilities in AI applications.
- →Improved tensor handling and MTP support enhance model performance and efficiency.
- →UI and server updates provide better usability and debugging options for developers.
llama.cpp has released version 0.3.0, featuring the new dots3-note multimodal model with a DSA-ISWA KV cache. This update includes MTP support for GLM-4.5-Air and improvements in tensor handling with ggml v0.22.0. The server now offers a new debug knob, and the web UI has been updated with tabbed chat navigation. These enhancements aim to improve performance and usability for developers working with multimodal AI applications.
Read originalMore from llama.cpp Releases
Models & Labsmodels
llama.cpp b10618 Release Enhances Parsing
The b10618 release of llama.cpp tackles a crucial parsing issue, specifically improving the handling of hyphens in character classes. This update ensures that generated tool-call grammars are parsed correctly, enhancing the software's reliability. With new parser and integration tests included, the release verifies these improvements effectively. While it doesn't introduce major new features, this update strengthens llama.cpp's core functionality, making it more dependable for developers working on different operating systems and hardware configurations.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10620 Release Expands Platform Support
The b10620 release of llama.cpp marks another step in broadening its platform reach, now supporting systems like Ubuntu with Vulkan and ROCm 7.14, alongside Windows with CUDA 13. This update underscores llama.cpp's adaptability, making it a go-to tool for developers working across various hardware configurations, from macOS Apple Silicon to Windows arm64. While the release doesn't introduce new groundbreaking features, it reinforces llama.cpp's role as a flexible inference runtime. By ensuring compatibility with more systems, llama.cpp becomes increasingly accessible to developers, allowing them to leverage its capabilities regardless of their hardware setup.
