
In the wake of Anthropic's Fable shutdown, there is a growing interest in open-source and smaller efficient models such as GLM 5.2, Kimi 2.7, Vibe Thinker, and Cursor Composer 2.5. These models are becoming popular for their ability to support local hosting and offer lower-cost inference solutions. This shift highlights a trend towards more accessible AI technologies that do not rely on large, centralized models.
Read originalEarlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.
This release quietly expands llama.cpp's hardware support to include Qualcomm's Hexagon NPU on Linux arm64, a significant step for local inference on Snapdragon devices. It also updates CUDA builds to version 13.4 and introduces ROCm 10.0 binaries, keeping the project aligned with the latest NVIDIA and AMD driver ecosystems. KleidiAI on Apple Silicon is temporarily disabled in this build, likely due to stability checks rather than a feature rollback. For developers targeting edge AI or diverse GPU stacks, this update ensures broader compatibility without requiring custom compilation.
© Lev SelectorNVIDIA introduced the NVFP4 4-bit format and SoL-Pi technology, which uses 2x fewer tokens for improved efficiency.
GitHub Changelog · June 9, 2026 · Related
Sam Witteveen · June 9, 2026 · Related
Skill Leap AI · June 9, 2026 · Related
Fireship · June 11, 2026 · Background
TechCrunch AI · June 13, 2026 · Related
Cole Medin · June 13, 2026 · Related
Together AI Blog · June 17, 2026 · Related
Sam Witteveen · June 17, 2026 · Related
Matt Wolfe · July 1, 2026 · Related
TechCrunch AI · July 7, 2026 · Related
The Rundown AI · July 20, 2026 · Related
GitHub Changelog · September 1, 2026 · Related
The Rundown AI · September 2, 2026 · Related