
Nous Research, an open-source AI laboratory, has successfully raised $75 million in funding, achieving a valuation of $1.5 billion. The lab focuses on developing open-weight AI models and contributing to the broader AI research community. This funding round underscores the growing interest and investment in open-source AI initiatives.
Read original
© Lev SelectorAnaconda has acquired Kilo Code, expanding its capabilities in data science and AI development.
© Lev SelectorPrismML has successfully run a 27 billion parameter model on an iPhone, showcasing mobile AI capabilities.
© Lev SelectorVulkan and Mojo are emerging as competitors to Nvidia CUDA, enabling LLMs to run efficiently on diverse hardware.
The b10056 release of llama.cpp continues its trend of broadening platform compatibility, making it a versatile tool for developers across various systems. Notably, this update includes support for Ubuntu with ROCm 7.2, enhancing performance for AMD GPU users. The release also maintains its commitment to diverse hardware by supporting both Intel and Apple Silicon on macOS, as well as Vulkan and OpenVINO on Windows. While no groundbreaking new features are introduced, the steady expansion of supported environments ensures that llama.cpp remains a go-to choice for developers seeking flexibility in AI model deployment.
The b10058 release of llama.cpp marks a notable step forward with the addition of Vulkan Q2_0, significantly boosting performance for matrix-vector multiplication tasks. By optimizing the rows per workgroup, the update addresses initial inefficiencies, leading to improved computational efficiency. The release also tackles merge conflicts and fine-tunes error thresholds for specific operations. While it doesn't introduce new model architectures, this update strengthens llama.cpp's role as a robust tool for developers across platforms like macOS, Linux, Windows, and openEuler. The inclusion of ROCm 7.2 and CUDA 12 and 13 builds further broadens its applicability, making it a more versatile choice for diverse development environments.
The b10066 release of llama.cpp marks another step in broadening its compatibility across different hardware environments. With the addition of ROCm 7.2 support on Ubuntu x64, AMD GPU users can now enjoy improved performance, narrowing the gap with NVIDIA's CUDA. This update continues to cater to a wide range of systems, including macOS, Windows, and Linux, ensuring developers can utilize llama.cpp's capabilities regardless of their setup. Although there are no new groundbreaking features, the ongoing expansion of platform support reinforces llama.cpp's reputation as a flexible and adaptable tool for AI inference.