Open Source
llama.cpp b10066 Release Expands Platform Support
llama.cpp Releaseshigh confidence
Why it matters
- →Expanding platform support increases accessibility for developers using different hardware.
- →ROCm 7.2 support is crucial for AMD GPU users seeking alternatives to NVIDIA's CUDA.
- →Consistent updates ensure llama.cpp remains a versatile tool for AI inference across systems.
The b10066 release of llama.cpp has been announced, featuring expanded support across multiple platforms. This update includes ROCm 7.2 support on Ubuntu x64, enhancing accessibility for AMD GPU users. The release continues to support a wide array of operating systems, including macOS, Windows, and Linux, ensuring compatibility with various hardware configurations. While the update doesn't introduce new features, it reinforces llama.cpp's role as a flexible and widely compatible AI inference tool.
Read originalMore from llama.cpp Releases
Open Sourcemodels
llama.cpp b10056 Release Expands Platform Support
The b10056 release of llama.cpp continues its trend of broadening platform compatibility, making it a versatile tool for developers across various systems. Notably, this update includes support for Ubuntu with ROCm 7.2, enhancing performance for AMD GPU users. The release also maintains its commitment to diverse hardware by supporting both Intel and Apple Silicon on macOS, as well as Vulkan and OpenVINO on Windows. While no groundbreaking new features are introduced, the steady expansion of supported environments ensures that llama.cpp remains a go-to choice for developers seeking flexibility in AI model deployment.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10057 release focuses on SYCL fixes
The b10057 release of llama.cpp targets critical SYCL-related issues, enhancing the stability of its computation kernels. A significant fix addresses a row calculation error when K_QUANTS_PER_ITERATION is set to 1, ensuring more accurate results. Additionally, the update corrects the processing of reordered q5_k kernels, which is crucial for maintaining performance integrity. These improvements, contributed by Intel's Todd Malsbary, are designed to bolster the accuracy and efficiency of SYCL operations. While no new features are introduced, the release strengthens the existing framework, providing developers with a more reliable environment for SYCL-based computations.
llama.cpp Releases
Open Sourcecoding
llama.cpp b10058 release enhances Vulkan support
The b10058 release of llama.cpp marks a notable step forward with the addition of Vulkan Q2_0, significantly boosting performance for matrix-vector multiplication tasks. By optimizing the rows per workgroup, the update addresses initial inefficiencies, leading to improved computational efficiency. The release also tackles merge conflicts and fine-tunes error thresholds for specific operations. While it doesn't introduce new model architectures, this update strengthens llama.cpp's role as a robust tool for developers across platforms like macOS, Linux, Windows, and openEuler. The inclusion of ROCm 7.2 and CUDA 12 and 13 builds further broadens its applicability, making it a more versatile choice for diverse development environments.
llama.cpp Releases
More in Open Source
© Lev SelectorInvestment · $75 Mn
Open Sourceresearch
Nous Research Secures $75 Million Funding
Nous Research, an open-source AI lab, has raised $75 million at a $1.5 billion valuation.
Lev Selector
© Lev SelectorOpen Sourcemodels
Tencent Releases Hy3: Open MoE LLM
Tencent has released Hy3, an open-source mixture of experts (MoE) large language model.
Lev Selector
© TechCrunch AIOpen Sourceresearch
Hugging Face CEO Advocates for Open Source AI
Clem Delangue, CEO of Hugging Face, underscores the critical role of open source AI, comparing the platform to a GitHub for AI models and datasets. He observes that as companies expand, they often move from expensive proprietary APIs to more affordable open source options, which he believes is essential for democratizing AI technology. Delangue voices concerns about the risk of a few large companies dominating the AI landscape, advocating for openness and transparency, particularly in the field of robotics. This approach is reflected in Hugging Face's decision to focus on capital efficiency rather than traditional fundraising, even declining a significant investment offer from Nvidia to stay true to its open source principles.
TechCrunch AI