Open Source
Bonsai 2 and Needle: Tiny Local AI Models
Lev Selectorhigh confidence
Why it matters
- →Enables offline, private AI usage.
- →Reduces infrastructure costs significantly.
- →Demonstrates efficiency gains in model design.
Developers have released Bonsai 2 and Needle, two extremely lightweight AI models weighing only 8-29 MB. These models are designed for offline action and local deployment, proving that small parameter counts can still deliver high utility for specific tasks. They enable real-time decision-making without cloud dependency, reducing latency and privacy concerns. This trend highlights the growing viability of edge AI for everyday applications.
Read originalMore from Lev Selector
© Lev SelectorMarket & Regulationbusiness
OpenAI Eyes $1.5 Trillion Valuation
Reports indicate OpenAI is targeting a valuation of $1.5 trillion in its next funding round, reflecting massive investor confidence.
Lev Selector
© Lev SelectorMarket & Regulationbusiness
Cohere and Aleph Alpha Announce $20B Merger
More in Open Source
Open Sourceother
llama.cpp b11153 adds ROCm 10 and Snapdragon support
This release quietly cements llama.cpp as the universal inference runtime by finally bringing first-class ROCm 10.0 support to both Linux and Windows. AMD GPU users no longer need workarounds, effectively closing a long-standing parity gap with NVIDIA's CUDA ecosystem. Equally notable is the new Linux arm64 build targeting Snapdragon chips, which unlocks local AI on high-performance mobile hardware via CPU, Adreno GPU, and Hexagon NPU acceleration. While KleidiAI on Apple Silicon has been disabled in this specific binary, the broader platform expansion signals that llama.cpp is aggressively standardizing how models run across every major silicon architecture.
llama.cpp Releases
Open Sourcemodels
llama.cpp b10989 Release Expands Platform Support
The latest b10989 release of llama.cpp continues its trend of broadening platform compatibility, now supporting a wide array of systems including macOS, Linux, Windows, and openEuler. Notably, this update includes support for CUDA 13.3 libraries on Ubuntu and Windows, as well as ROCm 10.0, enhancing its utility for AMD GPU users. While KleidiAI support is disabled on macOS, the release still marks a significant step in making llama.cpp a versatile tool for developers across different hardware configurations. This update doesn't introduce new models but focuses on expanding the accessibility of existing capabilities.