Models & Labs
llama.cpp b10659 Release Enhances Windows ROCm
llama.cpp Releaseshigh confidence
Why it matters
- →Bundling HIP runtime DLLs improves compatibility for Windows ROCm users.
- →Resolves a specific issue with runtime loading, enhancing reliability.
- →Focuses on refining platform performance rather than introducing new features.
The b10659 release of llama.cpp introduces a key update for Windows users by bundling HIP runtime DLLs with the Windows ROCm release. This adjustment ensures the correct HIP runtime loads over the driver's copy in System32, resolving a previously identified issue. The update does not include new model architectures but focuses on enhancing compatibility and performance. This release is particularly relevant for developers using Windows, as it simplifies the setup process and may improve runtime efficiency.
Read originalMore from llama.cpp Releases
Open Sourcemodels
llama.cpp b10656 release expands platform support
The latest b10656 release of llama.cpp continues its trend of broadening platform compatibility, now supporting a wide array of systems including macOS, Linux, Windows, and openEuler. Notably, this update includes support for Vulkan and ROCm 7.14 on Ubuntu, as well as CUDA 13 on Windows, which enhances performance on AMD and NVIDIA GPUs. While KleidiAI support for Apple Silicon is disabled, the release still marks a significant step in making llama.cpp a versatile tool across diverse hardware configurations. This update doesn't introduce new models but solidifies llama.cpp's position as a flexible inference runtime for developers.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10657 Release Expands Platform Support
The b10657 release of llama.cpp brings new OpenCL binary kernels, enhancing performance and compatibility across a wide range of systems. This update includes specific improvements for Apple Silicon, with KleidiAI support, and Vulkan on Ubuntu, making it more accessible for developers using these platforms. While no new model architectures are introduced, the release focuses on strengthening llama.cpp's capabilities as an inference runtime, particularly for those not using NVIDIA hardware. With ROCm 7.14 support on Ubuntu and CUDA 12 and 13 DLLs for Windows, llama.cpp continues to evolve as a versatile tool for AI model deployment. This release underscores the commitment to broadening hardware compatibility and optimizing performance across different environments.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10658 release adds DFlash2 support
The b10658 release of llama.cpp marks a significant enhancement with the addition of DFlash2, which boosts local convolution and candidate selection capabilities. This update, with contributions from Claude Opus 5, focuses on optimizing costs and refining the code structure for better performance and maintainability. It also resolves several bugs and formatting issues, ensuring a more stable runtime. These improvements make llama.cpp more robust and efficient, catering to developers across various platforms. The release continues to solidify llama.cpp's position as a versatile tool for AI development.
llama.cpp Releases
More in Models & Labs
Models & Labsmodels
vLLM v0.28.0 Release: Major Performance Enhancements
The v0.28.0 release of vLLM introduces substantial improvements in performance and functionality, particularly for the Kimi-K3 model. With the addition of Decode Context Parallel support and fused FlashKDA decode kernels, the update significantly enhances processing speed and efficiency. DeepSeek V4 now includes sparse MLA support and advances in speculative decoding, offering better execution on both NVIDIA and AMD hardware. These updates make vLLM more robust and adaptable, providing developers with enhanced tools for deploying and executing models on a broader range of hardware configurations.
vLLM Releases
© TechCrunch AIModels & Labsmodels
Hugging Face Launches $399 Open Source Robot, Microduck
Hugging Face has introduced the Microduck, a $399 open-source robot designed to democratize physical AI. This duck-like robot, equipped with a camera, lidar sensors, and IMUs, can perform tasks like waddling, picking up objects, and roller skating. The Microduck's behaviors can be trained in simulation and deployed directly, offering developers a platform to experiment with reinforcement learning. This launch marks Hugging Face's continued expansion into affordable AI hardware, following their acquisition of Pollen Robotics and the release of the Reachy Mini robots.
TechCrunch AI
© The Rundown AIModels & Labsmodels
Z AI Reveals Ox Alpha as GLM-5.3-Flash
Z AI has unveiled that the enigmatic Ox Alpha model is their latest GLM-5.3-Flash, a move that could reshape the AI landscape with its affordability and performance. Priced at just a tenth of its competitors, this model has quickly risen to prominence, topping OpenRouter's rankings. The fact that it operates entirely on Chinese-made chips suggests a significant stride in reducing dependency on foreign technology. This development not only makes advanced AI more accessible but also positions Z AI as a formidable contender in the AI market, offering a viable alternative to more expensive models.
The Rundown AI