Models & Labs
llama.cpp b10286 Release Expands Platform Support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands platform support, making AI tools more accessible to developers using non-NVIDIA hardware.
- →Enhances compatibility with diverse systems, broadening the potential user base.
- →Focuses on runtime improvements, ensuring efficient AI inference across various architectures.
The b10286 release of llama.cpp has been announced, featuring expanded support for various platforms. Notable additions include Ubuntu support with ROCm 7.2 and Windows compatibility with CUDA 13.3. The update enhances the runtime environment without introducing new models, focusing on broadening accessibility across different hardware architectures. This positions llama.cpp as a versatile tool for developers working with diverse systems, reinforcing its role as a comprehensive AI inference solution.
Read originalMore from llama.cpp Releases
Models & Labsmodels
llama.cpp b10278 Release Expands Platform Support
The latest b10278 release of llama.cpp continues its trend of broadening platform compatibility, making it a versatile choice for developers across different systems. Notably, the release includes support for ROCm 7.2 on Ubuntu x64, which is significant for AMD GPU users seeking alternatives to NVIDIA's CUDA. The inclusion of Vulkan support on both Ubuntu and Windows platforms further enhances its appeal for developers working with graphics-intensive applications. While there are no groundbreaking new features, this update solidifies llama.cpp's position as a flexible and inclusive inference runtime for diverse hardware configurations.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10280 Release Expands Platform Support
The b10280 release of llama.cpp marks another step in broadening its reach across various platforms, making it more adaptable for different systems. This update introduces Vulkan support on both Ubuntu and Windows, alongside ROCm 7.2 for Ubuntu, which is a significant boost for AMD GPU users. Windows x64 now benefits from the inclusion of CUDA 12 and 13 DLLs, enhancing its utility for developers. While there are no new models or quantization methods, this release reinforces llama.cpp's role as a flexible and comprehensive solution for AI inference across a wide range of hardware configurations.
llama.cpp Releases
Models & Labsmodels
Llama.cpp b10285 Release Enhances Deepseek-OCR
The latest b10285 release of llama.cpp introduces significant improvements for deepseek-ocr, particularly with multi-row batching support. This update allows for more efficient processing by weaving deepseek-ocr rows in one shot rather than individually, which could enhance performance in OCR tasks. The release also includes a variety of platform-specific builds, such as support for ROCm 7.2 on Ubuntu and CUDA 13 on Windows. While there are no groundbreaking new features, these enhancements make llama.cpp a more versatile tool for developers working with OCR and other AI applications.
llama.cpp Releases
More in Models & Labs
© TechCrunch AIModels & Labscoding
Meta Introduces Muse Code for Large Code Bases
Meta is stepping up its AI game with the launch of Muse Code, a terminal coding agent designed to handle complex tasks across large software repositories. This new tool, currently in beta, leverages Meta's Muse Spark model to manage extensive projects by deploying sub-agents that work in parallel, ensuring efficient task execution without interfering with the user's working copy. By offering a cost-effective alternative to competitors like OpenAI's Codex, Meta aims to strengthen its position in the AI coding space. This move marks a significant shift as Meta expands its AI focus beyond advertising into broader enterprise applications.
TechCrunch AI
© The AI Daily BriefModels & Labsmodels
Qwen 3.8 Max Launches with Open Weights
Qwen 3.8 Max has been released with open weights, featuring aggressive pricing and contested benchmark claims.
The AI Daily Brief
© TechCrunch AIModels & Labsmodels
MacPaw Partners with Liquid AI for On-Device Inference
MacPaw's collaboration with Liquid AI marks a significant step towards enhancing privacy and performance in AI applications by enabling on-device inference. This partnership aims to develop a system called Elix, which will allow AI models to run directly on devices, offering benefits like offline functionality and improved security. By integrating this technology into its SetApp store, MacPaw plans to provide developers with a robust platform for building AI-powered apps. This move not only positions MacPaw as a key player in the AI app ecosystem but also offers developers a unique opportunity to leverage local and cloud-based AI models seamlessly.
TechCrunch AI