Models & Labs
Vulkan and Mojo Challenge Nvidia CUDA
Lev Selectorhigh confidence
Why it matters
- →Breaks Nvidia CUDA's long-standing monopoly in deep learning.
- →Enables more flexible and efficient deployment of AI models.
- →Attracts significant investment, indicating industry confidence.
Vulkan, a cross-platform GPU API from the gaming industry, and Mojo, a Python-like language developed by Chris Lattner's Modular, are challenging Nvidia's CUDA in the deep learning space. Vulkan allows large language models (LLMs) to operate on any hardware, while Mojo achieves CUDA-level performance with significantly less code. Qualcomm recently acquired Modular for approximately $4 billion, highlighting the growing interest in these technologies.
Read originalMore from Lev Selector
© Lev SelectorMarket & Regulationbusiness
Anaconda Acquires Kilo Code
Anaconda has acquired Kilo Code, expanding its capabilities in data science and AI development.
Lev Selector
© Lev SelectorModels & Labsmodels
PrismML Runs 27B-Parameter Model on iPhone
PrismML has successfully run a 27 billion parameter model on an iPhone, showcasing mobile AI capabilities.
Lev Selector
© Lev SelectorInvestment · $75 Mn
Open Sourceresearch
Nous Research Secures $75 Million Funding
Nous Research, an open-source AI lab, has raised $75 million at a $1.5 billion valuation.
Lev Selector
More in Models & Labs
Models & Labsmodels
llama.cpp b10057 release focuses on SYCL fixes
The b10057 release of llama.cpp targets critical SYCL-related issues, enhancing the stability of its computation kernels. A significant fix addresses a row calculation error when K_QUANTS_PER_ITERATION is set to 1, ensuring more accurate results. Additionally, the update corrects the processing of reordered q5_k kernels, which is crucial for maintaining performance integrity. These improvements, contributed by Intel's Todd Malsbary, are designed to bolster the accuracy and efficiency of SYCL operations. While no new features are introduced, the release strengthens the existing framework, providing developers with a more reliable environment for SYCL-based computations.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10063 Release Expands Platform Support
The latest b10063 release of llama.cpp continues its trend of broadening platform compatibility, now including support for Vulkan on Ubuntu and Windows, as well as ROCm 7.2 on Ubuntu. This update ensures that developers working across diverse hardware configurations can leverage llama.cpp's capabilities more effectively. Notably, the release maintains its focus on providing robust support for both CPU and GPU environments, including CUDA and OpenVINO. While no groundbreaking features are introduced, the expansion of supported platforms signifies llama.cpp's commitment to being a versatile tool for AI developers.
llama.cpp Releases
Models & Labsmodels
llama.cpp b10064 Release Expands Platform Support
The latest b10064 release of llama.cpp continues its trend of broadening platform compatibility, now supporting a wide array of systems including macOS, Linux, Windows, and openEuler. Notably, this update includes support for Vulkan on Ubuntu and Windows, as well as ROCm 7.2 on Ubuntu, which enhances GPU utilization options for developers. While KleidiAI support on macOS Apple Silicon is disabled, the release still offers a comprehensive suite of builds for various architectures. This update solidifies llama.cpp's position as a versatile inference runtime, catering to a diverse range of hardware configurations.
llama.cpp Releases