Models & Labs
llama.cpp b10333 Release Expands Platform Support
llama.cpp Releaseshigh confidence
Why it matters
- →Expands platform support, making llama.cpp more versatile for developers.
- →Enhances GPU performance options with Vulkan and ROCm 7.2 support.
- →Strengthens compatibility with NVIDIA GPUs through CUDA 12 and 13 support.
The b10333 release of llama.cpp has been announced, featuring expanded support across multiple platforms. This update includes Vulkan support for both Ubuntu and Windows, as well as ROCm 7.2 for Ubuntu, enhancing GPU performance capabilities. Additionally, Windows x64 now supports CUDA 12 and 13, providing improved compatibility with NVIDIA GPUs. While the release does not introduce new model architectures, it continues to position llama.cpp as a versatile tool for AI inference across various hardware environments.
Read originalMore from llama.cpp Releases
Models & Labsmodels
llama.cpp b10412 Release Enhances Backend Sampling
The latest b10412 release of llama.cpp introduces backend sampling for both dflash and dspark, marking a technical enhancement in the platform's capabilities. This update allows for more refined control with the enablement of p_min > 0 in backend sampling, adding a layer of precision for developers. While the release doesn't introduce new models or architectures, it quietly strengthens the platform's backend functionality, making it more versatile for developers working across various systems. This update is a step forward in optimizing the performance and flexibility of llama.cpp's inference capabilities.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10414 Release Adds TQ2_0 Support
The b10414 release of llama.cpp marks a significant enhancement with the addition of GGML_TYPE_TQ2_0 type processing in the Metal backend, enabling ternary operations with 2 bits per element. This update brings a more efficient mul_mv kernel, focusing on float operations and optimizing data handling through techniques like precalculating sums. While the release doesn't feature new models, it refines the platform's performance and broadens its compatibility across systems like macOS, Linux, and Windows. By improving efficiency and versatility, llama.cpp continues to be a valuable tool for developers working with a variety of hardware configurations.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10418 Release Enhances SYCL Support
The b10418 release of llama.cpp brings notable improvements to SYCL support, particularly through the introduction of host pinned memory, which enhances host-to-device memory access. This update also resolves a thread-safety issue, ensuring more stable performance across different hardware setups. While no new models are introduced, the release focuses on strengthening the existing infrastructure, making it more robust for developers working with SYCL. This update is crucial for optimizing performance and ensuring compatibility, especially for those leveraging SYCL in their development environments.
llama.cpp Releases
More in Models & Labs
© TechCrunch AIModels & Labsmodels
Writer launches cost-cutting AI model Palmyra X6
Writer has unveiled Palmyra X6, a new AI model designed to significantly reduce token costs for enterprises. Built on Z.ai’s open source GLM-5.2, this model aims to cut costs by up to 50% for basic tasks, addressing the growing concern over AI deployment expenses. Alongside the model, Writer has enhanced its agentic harness, optimizing it for complex, multi-step tasks. This dual approach not only promises cost efficiency but also challenges the dominance of major AI labs by offering a more economical alternative for businesses.
TechCrunch AI
© The AI Daily BriefModels & Labsmodels
Grok 4.6 Launches with Enhanced Speed and Affordability
Grok 4.6 offers improved speed and cost-effectiveness, challenging leading AI models.
The AI Daily Brief
© TechCrunch AIModels & Labsmodels
OpenAI Unveils Ultrafast Mode for GPT-5.6 Sol
OpenAI's new Ultrafast mode for GPT-5.6 Sol significantly boosts processing speed, achieving up to 14 times the standard rate. This enhancement allows the model to generate up to 750 tokens per second, making it a game-changer for real-time applications. Unlike previous solutions that required smaller models for speed, Ultrafast maintains the power of GPT-5.6 Sol while accelerating its output. Initially available to a select group, this feature is set to transform workflows in areas like customer service and financial analysis as access expands.
TechCrunch AI