Models & Labs
llama.cpp b10278 Release Expands Platform Support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands support for AMD GPUs with ROCm 7.2, offering alternatives to CUDA.
- →Enhances compatibility with Vulkan, benefiting graphics-intensive applications.
- →Strengthens llama.cpp's position as a versatile inference runtime across platforms.
The b10278 release of llama.cpp has been announced, focusing on expanding platform support. This update includes ROCm 7.2 support for Ubuntu x64, catering to AMD GPU users, and Vulkan support for both Ubuntu and Windows, which is beneficial for graphics applications. While no new model architectures are introduced, the release enhances compatibility across various systems, reinforcing llama.cpp's role as a versatile inference runtime. This update is particularly relevant for developers seeking flexible deployment options across different hardware.
Read originalMore from llama.cpp Releases
Models & Labsmodels
llama.cpp b10280 Release Expands Platform Support
The b10280 release of llama.cpp marks another step in broadening its reach across various platforms, making it more adaptable for different systems. This update introduces Vulkan support on both Ubuntu and Windows, alongside ROCm 7.2 for Ubuntu, which is a significant boost for AMD GPU users. Windows x64 now benefits from the inclusion of CUDA 12 and 13 DLLs, enhancing its utility for developers. While there are no new models or quantization methods, this release reinforces llama.cpp's role as a flexible and comprehensive solution for AI inference across a wide range of hardware configurations.
llama.cpp Releases
Models & Labsmodels
Llama.cpp b10285 Release Enhances Deepseek-OCR
The latest b10285 release of llama.cpp introduces significant improvements for deepseek-ocr, particularly with multi-row batching support. This update allows for more efficient processing by weaving deepseek-ocr rows in one shot rather than individually, which could enhance performance in OCR tasks. The release also includes a variety of platform-specific builds, such as support for ROCm 7.2 on Ubuntu and CUDA 13 on Windows. While there are no groundbreaking new features, these enhancements make llama.cpp a more versatile tool for developers working with OCR and other AI applications.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10286 Release Expands Platform Support
The latest b10286 release of llama.cpp continues its trend of broadening platform compatibility, now including support for systems like Ubuntu with ROCm 7.2 and Windows with CUDA 13.3. This update doesn't introduce new models but focuses on enhancing the runtime environment across different architectures, making it more accessible for developers working with diverse hardware. By adding Vulkan and OpenVINO support on various operating systems, llama.cpp is positioning itself as a versatile tool for AI inference. This release underscores the project's commitment to being a comprehensive solution for developers beyond the NVIDIA ecosystem.
llama.cpp Releases
More in Models & Labs
© TechCrunch AIModels & Labscoding
Meta Introduces Muse Code for Large Code Bases
Meta is stepping up its AI game with the launch of Muse Code, a terminal coding agent designed to handle complex tasks across large software repositories. This new tool, currently in beta, leverages Meta's Muse Spark model to manage extensive projects by deploying sub-agents that work in parallel, ensuring efficient task execution without interfering with the user's working copy. By offering a cost-effective alternative to competitors like OpenAI's Codex, Meta aims to strengthen its position in the AI coding space. This move marks a significant shift as Meta expands its AI focus beyond advertising into broader enterprise applications.
TechCrunch AI
© The AI Daily BriefModels & Labsmodels
Qwen 3.8 Max Launches with Open Weights
Qwen 3.8 Max has been released with open weights, featuring aggressive pricing and contested benchmark claims.
The AI Daily Brief
© TechCrunch AIModels & Labsmodels
MacPaw Partners with Liquid AI for On-Device Inference
MacPaw's collaboration with Liquid AI marks a significant step towards enhancing privacy and performance in AI applications by enabling on-device inference. This partnership aims to develop a system called Elix, which will allow AI models to run directly on devices, offering benefits like offline functionality and improved security. By integrating this technology into its SetApp store, MacPaw plans to provide developers with a robust platform for building AI-powered apps. This move not only positions MacPaw as a key player in the AI app ecosystem but also offers developers a unique opportunity to leverage local and cloud-based AI models seamlessly.
TechCrunch AI