Models & Labs
llama.cpp b9388 release enhances Turing support
llama.cpp Releaseshigh confidence
Why it matters
- →Enhances compatibility for Turing architecture, crucial for developers using these GPUs.
- →Addresses JIT compilation issues, improving performance and reliability.
- →Expands platform support, making llama.cpp more versatile for diverse hardware.
The b9388 release of llama.cpp focuses on optimizing support for Turing architecture, specifically addressing JIT compilation issues for SM75 Turing devices. This update adds MMVQ_PARAMETERS_TURING to prevent mismatches when compiling Turing device code on newer architectures like Ampere. The release also includes platform support updates for macOS, Linux, and Windows, though no new models or quantization methods are introduced. This iteration enhances compatibility and performance, reinforcing llama.cpp's utility for developers working across various hardware setups.
Read originalMore from llama.cpp Releases
Models & Labsmodels
Llama.cpp b9387 Release Enhances AMD MFMA Performance
The latest b9387 release of llama.cpp introduces significant performance improvements for AMD MFMA hardware, particularly in quantized matrix multiplication. By optimizing the batch threshold logic, the update allows for more efficient processing, with throughput gains of up to 76% in certain configurations. This release is particularly relevant for users leveraging AMD's MI250X hardware, as it fine-tunes the kernel selection logic to maximize performance. While the update doesn't introduce new models, it significantly enhances the efficiency of existing operations on specific hardware, making it a noteworthy development for those using AMD GPUs.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9389 Release Expands Platform Support
The latest b9389 release of llama.cpp continues its trend of broadening platform compatibility, though with some notable exceptions. While macOS Apple Silicon users see KleidiAI support disabled, the release strengthens its Linux offerings with ROCm 7.2 and Vulkan support. Windows users benefit from updated CUDA DLLs, enhancing performance for CUDA 12 and 13. This release demonstrates llama.cpp's commitment to being a versatile inference runtime across diverse hardware, though some features remain disabled, indicating ongoing development challenges.
llama.cpp Releases
Open Sourcemodels
llama.cpp b9391 release expands platform support
The b9391 release of llama.cpp continues to broaden its platform support, making it more accessible to a diverse range of users. Notably, this update includes support for Ubuntu x64 with ROCm 7.2, which is significant for AMD GPU users seeking alternatives to NVIDIA's CUDA. While some features like KleidiAI on macOS Apple Silicon and SYCL FP32 on Ubuntu are disabled, the release still marks a step forward in making llama.cpp a versatile tool across different operating systems. This update doesn't introduce new models but enhances the existing infrastructure, ensuring more users can leverage llama.cpp's capabilities.
llama.cpp Releases
More in Models & Labs
Models & Labsmodels
vLLM v0.20.2 Patch Release
The vLLM v0.20.2 release is a minor update focusing on bug fixes for DeepSeek V4, gpt-oss, and Qwen3-VL. This patch addresses specific issues such as the MTP=1 hang on DeepSeek V4 by re-enabling the persistent topk path and fixing a KV cache allocation error. For gpt-oss, the update ensures compatibility with MXFP4 under torch.compile, while Qwen3-VL sees the removal of an invalid boundary check. These fixes enhance the stability and performance of the models, ensuring smoother operations under various conditions.
vLLM Releases
© TechCrunch AIModels & Labsmodels
AWS Launches OpenSearch Serverless for AI Agents
AWS is reshaping its cloud infrastructure to better accommodate AI agents with the launch of its next-generation OpenSearch Serverless. This new system is designed to handle the unpredictable traffic patterns of AI agents, scaling compute resources up and down as needed, which can significantly reduce costs for users. By decoupling compute from storage, AWS allows for instant scalability, ensuring that resources are only used when necessary. This shift reflects a broader industry trend as cloud providers adapt to the growing presence of machine-generated traffic, making AI agents more efficient and cost-effective to deploy.
TechCrunch AI
© TechCrunch AIModels & Labsmodels
Anthropic releases Opus 4.8 with Dynamic Workflow
Anthropic's release of Opus 4.8 marks a significant step forward in AI model development, particularly with its new Dynamic Workflows feature. This tool allows the model to manage complex tasks across numerous subagents, enhancing its capability to handle large-scale code migrations. The model also improves on handling uncertain data, proactively flagging potential issues, which sets it apart from competitors. While the Mythos model remains on hold due to cybersecurity concerns, Opus 4.8's advancements suggest Anthropic is keen to maintain its competitive edge in the rapidly evolving AI landscape.
TechCrunch AI