The b10771 release of llama.cpp has been announced, featuring the addition of the mtmd_tokenize_from_parts function. This update enhances the command-line interface and expands platform support, including macOS, Linux, Windows, and openEuler. The release includes compatibility with Vulkan, ROCm, and CUDA environments, although no new model architectures are introduced. This update underscores llama.cpp's focus on broadening its usability across various hardware configurations.
Read originalThe b10764 release of llama.cpp marks another step in its evolution, enhancing its reach across different computing environments. With new support for Ubuntu systems using Vulkan and ROCm 7.14, and Windows systems equipped with CUDA 13, developers gain more flexibility in deploying AI models. This update doesn't bring new features but reinforces llama.cpp's adaptability, making it a reliable choice for developers working with diverse hardware setups. By broadening its compatibility, llama.cpp continues to be a preferred runtime for those seeking performance optimization across a spectrum of platforms.
Llama.cpp's b10766 release marks a notable enhancement by enabling input vision capabilities for the deepseek4 model. This update expands the framework's reach across a variety of platforms, including macOS, Linux, and Windows, with integration for Vulkan, ROCm, and CUDA technologies. While no new models are added, the focus is on strengthening the existing infrastructure, making it more adaptable for developers using different hardware setups. This quiet yet impactful update ensures that llama.cpp remains a versatile and reliable tool for AI developers, enhancing its utility without altering its core model offerings.
Alibaba has released the Qwen3.8-27b model as open source, allowing local deployment.