Models & Labs
Qualcomm unveils Snapdragon 8 Elite Gen 6 with local AI focus
TechCrunch AIhigh confidence
Why it matters
- →Local execution of 30B-parameter MoE models enables complex AI agents without cloud dependency.
- →Dedicated sensing hubs offload small tasks, improving battery life and privacy for always-on features.
- →On-device AI performance is catching up to major foundation models like Apple's 20B parameter release.
Qualcomm announced the Snapdragon 8 Elite Gen 6 and Snapdragon 8 Elite Extreme Gen 6 processors at its annual summit, emphasizing local AI capabilities. The Extreme version supports running a 30-billion-parameter mixture-of-experts model locally, while a new sensing hub handles smaller models up to 200 million parameters for tasks like voice isolation and personal memory. Motorola confirmed it will launch the Signature 27 smartphone powered by the Extreme chip later this year. These chips aim to enable complete voice-in/voice-out agents and advanced camera features directly on the device.
Read originalThe story around this
Earlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.
How we got here
- 1Microsoft Unveils AI Models and Agentic Hardware at Build 2026
The Rundown AI · June 3, 2026 · Background
- 2Qualcomm's New Chip Boosts Smart Glasses Potential
The Verge AI · June 16, 2026 · Related
- 3Qualcomm Acquires Chip Startup Modular for $4 Billion
WIRED AI · June 24, 2026 · Background
- 4Scam.ai Partners with Qualcomm for On-Device Deepfake Detection
AI News · June 29, 2026 · Related
- 5Qualcomm Acquires Modular Amid AI Software Shift
Crunchbase News · June 30, 2026 · Background
- 6Google AI unveils major June 2026 updates
Google AI Blog · July 1, 2026 · Background
- 7Apple's AI Chips Emerge from Self-Driving Car Effort
The Verge AI · July 12, 2026 · Background
- 8Qualcomm Aims to Distribute AI Across Devices
Matt Wolfe · July 12, 2026 · Related
What happened next
- 9PrismML Tiny LLM Runs on Qualcomm Smart Glasses
TechCrunch AI · September 24, 2026 · Background
- 10The rise of SMS-native AI agents
TechCrunch AI · October 3, 2026 · Background
- 11Liquid AI releases efficient on-device agent model
Hugging Face Blog · October 13, 2026 · Background
- 12llama.cpp adds configurable Hexagon power modes
llama.cpp Releases · October 14, 2026 · Background
- 13llama.cpp b11680 Hexagon NPU and CUDA 13 support
llama.cpp Releases · October 16, 2026 · Background
More from TechCrunch AI
© TechCrunch AIMarket & Regulationbusiness
Google buys Crusoe's Wyoming data center project
Google is acquiring an unfinished data center from Crusoe in Wyoming, signaling a strategic pivot to direct infrastructure control amid scaling pressures. The $17 billion investment highlights the immense capital required for AI compute, as independent developers struggle with cost and timeline overruns. This move illustrates the growing vertical integration of tech giants into physical infrastructure, reducing reliance on third-party providers like Crusoe for massive deployments. By taking ownership, Google bypasses the bottlenecks that often plague external development teams. The deal reflects a broader industry trend where hyperscalers reclaim control over their most critical assets. Independent builders now face stiffer competition from companies with deeper pockets and direct operational oversight.
TechCrunch AI
© TechCrunch AIInvestment · $11B
Market & Regulationbusiness
OpenAI raises $11B at $1.25T valuation
OpenAI is securing an additional $11 billion in a funding round that values the company at $1.25 trillion, falling short of its initial $30 billion target but still signaling massive investor confidence. This latest capital injection comes as the broader AI market faces headwinds, with Anthropic’s potential IPO valuation also cooling from earlier highs. The move highlights OpenAI's continued ability to attract deep-pocketed support despite regulatory uncertainties and political shifts affecting data center expansion. While the round hasn't fully closed, the sheer scale of this valuation reinforces OpenAI's dominant position in the race for AI supremacy. Investors are betting big on the lab's ability to maintain its lead in compute and model capabilities. The delay in IPO plans suggests a strategic pause to navigate these complex market conditions. This funding ensures OpenAI remains the financial heavyweight in the sector.
TechCrunch AI
© TechCrunch AIMarket & Regulationother
Hundreds of Artex AI hacking tools exposed
Censys uncovered over 800 publicly accessible instances of Artex, an autonomous penetration testing tool linked to major breaches in Korean finance and ConnectWise. These exposed deployments reveal a critical security gap: powerful AI agents running without authentication turn offensive capabilities into open targets for misuse. The developers recently shifted to closed-source distribution, yet the code remains widely available on public repositories, leaving the threat landscape largely unchanged. This situation demonstrates how easily sophisticated AI-driven attacks can be launched by anyone with basic configuration skills. The widespread exposure underscores significant risks associated with misconfigured AI security tools.
TechCrunch AI
More in Models & Labs
Models & Labsother
llama.cpp b12177 adds CUDA 13 and ROCm 10
This release quietly closes the hardware gap for local inference by adding default support for CUDA 13.5 and ROCm 10.0 alongside existing CUDA 12 builds. AMD GPU users finally get first-class parity with NVIDIA, while Snapdragon mobile chips gain dedicated NPU acceleration paths. Apple Silicon KleidiAI is explicitly disabled here, a notable regression for Mac performance that suggests ongoing tuning issues. The inclusion of OpenVINO and SYCL backends further cements llama.cpp as the universal runtime for inference across nearly every major silicon architecture.
llama.cpp Releases
Models & Labsmodels
llama.cpp adds Kimi K3.1-Pro support
Kimi’s new K3.1-Pro model joins the llama.cpp ecosystem, bringing a distinct architectural twist to local inference. By replacing full-attention MLA layers with DSA (Dynamic Sparse Attention) and linear-attention KDA layers, this release tests how well sparse caching handles hybrid attention patterns. The implementation keeps indexer precision high to avoid quality loss during top-k selection, ensuring the model runs accurately on consumer hardware. This expands the library’s reach into newer Chinese open-weight models that rely on complex memory management.
llama.cpp Releases
Models & Labsother
llama.cpp b12182 release with CUDA 13 and ROCm 10
This release quietly cements llama.cpp as the universal inference runtime by adding default builds for CUDA 13.5 and ROCm 10.0 across Linux and Windows. The inclusion of ROCm 10 means AMD GPU users no longer need custom compilation to access modern acceleration, effectively closing the gap with NVIDIA's ecosystem support. While KleidiAI on Apple Silicon is disabled in this build, the broader platform coverage ensures that local inference remains accessible on virtually any hardware configuration without manual setup.
llama.cpp Releases