
Microsoft is reportedly pushing towards the development of cheaper in-house AI models. This initiative aims to reduce reliance on external AI providers and cut costs associated with AI deployment. By investing in its own AI capabilities, Microsoft seeks to enhance its competitive edge in the AI market.
Read originalEarlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.
This release quietly expands llama.cpp's hardware support to include Qualcomm's Hexagon NPU on Linux arm64, a significant step for local inference on Snapdragon devices. It also updates CUDA builds to version 13.4 and introduces ROCm 10.0 binaries, keeping the project aligned with the latest NVIDIA and AMD driver ecosystems. KleidiAI on Apple Silicon is temporarily disabled in this build, likely due to stability checks rather than a feature rollback. For developers targeting edge AI or diverse GPU stacks, this update ensures broader compatibility without requiring custom compilation.
© Lev SelectorNVIDIA introduced the NVFP4 4-bit format and SoL-Pi technology, which uses 2x fewer tokens for improved efficiency.
The Verge AI · June 2, 2026 · Related
The Rundown AI · June 3, 2026 · Related
The Verge AI · June 3, 2026 · Related
The AI Daily Brief · June 4, 2026 · Related
Matt Wolfe · June 8, 2026 · Related
Matt Wolfe · June 9, 2026 · Same story
TechCrunch AI · July 7, 2026 · Same story
TechCrunch AI · July 15, 2026 · Related
Microsoft Research · July 30, 2026 · Background
AI News · September 14, 2026 · Background