Models & Labs
llama.cpp b10280 Release Expands Platform Support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands platform support, making AI inference more accessible.
- →Enhances compatibility for AMD GPU users with ROCm 7.2.
- →Strengthens llama.cpp's position as a versatile inference runtime.
The b10280 release of llama.cpp has been announced, featuring expanded support for multiple platforms. This update includes Vulkan support for both Ubuntu and Windows, as well as ROCm 7.2 for Ubuntu, catering to AMD GPU users. Additionally, Windows x64 now supports CUDA 12 and 13, enhancing its versatility. Although there are no new models or quantization methods, this release emphasizes llama.cpp's role as a flexible inference runtime across different hardware setups.
Read originalMore from llama.cpp Releases
Models & Labsmodels
llama.cpp b10278 Release Expands Platform Support
The latest b10278 release of llama.cpp continues its trend of broadening platform compatibility, making it a versatile choice for developers across different systems. Notably, the release includes support for ROCm 7.2 on Ubuntu x64, which is significant for AMD GPU users seeking alternatives to NVIDIA's CUDA. The inclusion of Vulkan support on both Ubuntu and Windows platforms further enhances its appeal for developers working with graphics-intensive applications. While there are no groundbreaking new features, this update solidifies llama.cpp's position as a flexible and inclusive inference runtime for diverse hardware configurations.
llama.cpp Releases
Models & Labsmodels
Llama.cpp b10285 Release Enhances Deepseek-OCR
The latest b10285 release of llama.cpp introduces significant improvements for deepseek-ocr, particularly with multi-row batching support. This update allows for more efficient processing by weaving deepseek-ocr rows in one shot rather than individually, which could enhance performance in OCR tasks. The release also includes a variety of platform-specific builds, such as support for ROCm 7.2 on Ubuntu and CUDA 13 on Windows. While there are no groundbreaking new features, these enhancements make llama.cpp a more versatile tool for developers working with OCR and other AI applications.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10286 Release Expands Platform Support
The latest b10286 release of llama.cpp continues its trend of broadening platform compatibility, now including support for systems like Ubuntu with ROCm 7.2 and Windows with CUDA 13.3. This update doesn't introduce new models but focuses on enhancing the runtime environment across different architectures, making it more accessible for developers working with diverse hardware. By adding Vulkan and OpenVINO support on various operating systems, llama.cpp is positioning itself as a versatile tool for AI inference. This release underscores the project's commitment to being a comprehensive solution for developers beyond the NVIDIA ecosystem.
llama.cpp Releases
More in Models & Labs
© TechCrunch AIModels & Labscoding
Meta Introduces Muse Code for Large Code Bases
Meta is stepping up its AI game with the launch of Muse Code, a terminal coding agent designed to handle complex tasks across large software repositories. This new tool, currently in beta, leverages Meta's Muse Spark model to manage extensive projects by deploying sub-agents that work in parallel, ensuring efficient task execution without interfering with the user's working copy. By offering a cost-effective alternative to competitors like OpenAI's Codex, Meta aims to strengthen its position in the AI coding space. This move marks a significant shift as Meta expands its AI focus beyond advertising into broader enterprise applications.
TechCrunch AI
© The AI Daily BriefModels & Labsmodels
Qwen 3.8 Max Launches with Open Weights
Qwen 3.8 Max has been released with open weights, featuring aggressive pricing and contested benchmark claims.
The AI Daily Brief
© TechCrunch AIModels & Labsmodels
MacPaw Partners with Liquid AI for On-Device Inference
MacPaw's collaboration with Liquid AI marks a significant step towards enhancing privacy and performance in AI applications by enabling on-device inference. This partnership aims to develop a system called Elix, which will allow AI models to run directly on devices, offering benefits like offline functionality and improved security. By integrating this technology into its SetApp store, MacPaw plans to provide developers with a robust platform for building AI-powered apps. This move not only positions MacPaw as a key player in the AI app ecosystem but also offers developers a unique opportunity to leverage local and cloud-based AI models seamlessly.
TechCrunch AI