Models & Labs
Llama.cpp b10285 Release Enhances Deepseek-OCR
llama.cpp Releaseshigh confidence
Why it matters
- →Multi-row batching improves efficiency in OCR tasks.
- →Expanded platform support increases accessibility for developers.
- →Enhancements make llama.cpp more versatile for AI applications.
The b10285 release of llama.cpp brings notable updates, particularly for deepseek-ocr, with the addition of multi-row batching support. This change allows for more efficient processing by handling multiple rows simultaneously, rather than one at a time. The release also includes builds for various platforms, such as ROCm 7.2 on Ubuntu and CUDA 13 on Windows, broadening its compatibility. These updates enhance the tool's utility for developers working on OCR and AI applications, though no new model architectures are introduced.
Read originalMore from llama.cpp Releases
Models & Labsmodels
llama.cpp b10278 Release Expands Platform Support
The latest b10278 release of llama.cpp continues its trend of broadening platform compatibility, making it a versatile choice for developers across different systems. Notably, the release includes support for ROCm 7.2 on Ubuntu x64, which is significant for AMD GPU users seeking alternatives to NVIDIA's CUDA. The inclusion of Vulkan support on both Ubuntu and Windows platforms further enhances its appeal for developers working with graphics-intensive applications. While there are no groundbreaking new features, this update solidifies llama.cpp's position as a flexible and inclusive inference runtime for diverse hardware configurations.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10280 Release Expands Platform Support
The b10280 release of llama.cpp marks another step in broadening its reach across various platforms, making it more adaptable for different systems. This update introduces Vulkan support on both Ubuntu and Windows, alongside ROCm 7.2 for Ubuntu, which is a significant boost for AMD GPU users. Windows x64 now benefits from the inclusion of CUDA 12 and 13 DLLs, enhancing its utility for developers. While there are no new models or quantization methods, this release reinforces llama.cpp's role as a flexible and comprehensive solution for AI inference across a wide range of hardware configurations.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10286 Release Expands Platform Support
The latest b10286 release of llama.cpp continues its trend of broadening platform compatibility, now including support for systems like Ubuntu with ROCm 7.2 and Windows with CUDA 13.3. This update doesn't introduce new models but focuses on enhancing the runtime environment across different architectures, making it more accessible for developers working with diverse hardware. By adding Vulkan and OpenVINO support on various operating systems, llama.cpp is positioning itself as a versatile tool for AI inference. This release underscores the project's commitment to being a comprehensive solution for developers beyond the NVIDIA ecosystem.
llama.cpp Releases
More in Models & Labs
© TechCrunch AIModels & Labscoding
Meta Introduces Muse Code for Large Code Bases
Meta is stepping up its AI game with the launch of Muse Code, a terminal coding agent designed to handle complex tasks across large software repositories. This new tool, currently in beta, leverages Meta's Muse Spark model to manage extensive projects by deploying sub-agents that work in parallel, ensuring efficient task execution without interfering with the user's working copy. By offering a cost-effective alternative to competitors like OpenAI's Codex, Meta aims to strengthen its position in the AI coding space. This move marks a significant shift as Meta expands its AI focus beyond advertising into broader enterprise applications.
TechCrunch AI
© The AI Daily BriefModels & Labsmodels
Qwen 3.8 Max Launches with Open Weights
Qwen 3.8 Max has been released with open weights, featuring aggressive pricing and contested benchmark claims.
The AI Daily Brief
© TechCrunch AIModels & Labsmodels
MacPaw Partners with Liquid AI for On-Device Inference
MacPaw's collaboration with Liquid AI marks a significant step towards enhancing privacy and performance in AI applications by enabling on-device inference. This partnership aims to develop a system called Elix, which will allow AI models to run directly on devices, offering benefits like offline functionality and improved security. By integrating this technology into its SetApp store, MacPaw plans to provide developers with a robust platform for building AI-powered apps. This move not only positions MacPaw as a key player in the AI app ecosystem but also offers developers a unique opportunity to leverage local and cloud-based AI models seamlessly.
TechCrunch AI