Models & Labs
Google launches Guided Vision in Gemini Live
The Verge AIhigh confidence
Why it matters
- →Multimodal AI moves from chat interfaces to real-time physical world interaction.
- →Direct competition with Apple’s accessibility features intensifies in the smartphone market.
- →Accessibility tools are becoming a primary driver for consumer adoption of advanced vision models.
Google has launched Guided Vision in Gemini Live on compatible Android devices, enabling real-time audio descriptions of surroundings via the camera. Designed primarily for users with low vision, the feature allows individuals to identify objects, read small text, and ask follow-up questions about what they are viewing. It is available within the Gemini app, Google TalkBack, and as a settings shortcut on Android 9 and above. Google explicitly warns against using the tool for navigation or obstacle detection.
Read originalThe story around this
Earlier coverage that leads up to this article, and what followed. Lines connect each piece to the closest one after it, converging here.
How we got here
- 1Google unveils Gemini 3.5 and Omni at I/O 2026
Google AI Blog · June 5, 2026 · Related
- 2Google DeepMind launches Gemini 3.5 Live Translate
Google DeepMind · June 9, 2026 · Related
- 3Google Launches Gemini-Powered Home Speaker
WIRED AI · June 17, 2026 · Related
- 4Google Unveils Gemini-Powered Smart Speaker
TechCrunch AI · June 17, 2026 · Related
- 5Google's New Smart Speaker Lacks AI Readiness
The Verge AI · July 1, 2026 · Related
- 6Google Unveils AI Features at Made by Google 2026
TechCrunch AI · August 12, 2026 · Related
- 7Google's August AI Innovations: Gemini and Beyond
Google AI Blog · September 1, 2026 · Related
- 8Google Gemini 3.8 Flash TTS with Voice Cloning
Sam Witteveen · September 24, 2026 · Related
Follow this story
Open the full story →Google launches Gemini 3.8 Live Avatar for enterprise
4 developments
- Sep 24 · The Verge AI
Google launches Gemini 3.8 Live Avatar for enterprise - Sep 26 · Matt Wolfe
Google Gemini 3.8 Adds Live Avatar and TTS↳ Gemini 3.8 adds advanced Text-to-Speech capabilities alongside the previously announced Live Avatar feature. - Sep 27 · Sam Witteveen
Google Gemini Live Avatars GA - Oct 1 · The Verge AI
Google launches Guided Vision in Gemini Live (This article)↳ Google launches Guided Vision in Gemini Live to provide real-time audio scene description for Android users with low vision via TalkBack int
More from The Verge AI
© The Verge AIMarket & Regulationother
Judge dismisses Google AI Overviews antitrust suits
A federal judge has dismissed antitrust lawsuits from Chegg and Penske Media against Google’s AI Overviews, ruling that publishers have no legal right to expect search traffic in exchange for free content. This decision reinforces Google’s position that its search algorithms operate independently of publisher agreements, effectively shielding the company from liability as AI-generated answers divert user attention away from traditional web links. While the court acknowledged the economic pain for publishers, it emphasized that antitrust law cannot be used to mandate traffic flows or replace legislative action on digital market structures. This ruling significantly weakens the legal leverage publishers hold against tech giants leveraging their own data to build competitive AI products.
The Verge AI
© The Verge AIMarket & Regulationother
Kevin O'Leary's Utah AI data center halted by local backlash
The Stratos project, a proposed 40,000-acre AI campus in Utah backed by Kevin O’Leary, has collapsed after residents exposed a bypass of local zoning laws. By leveraging the Military Installation Development Authority to override county consent, developers secured state-level approval while keeping the community in the dark until the announcement. This triggered a political firestorm and a defamation lawsuit, proving that even massive capital cannot easily circumvent local democracy. The failure signals a growing friction point for the AI infrastructure boom as communities increasingly resist rapid industrialization.
The Verge AI
© The Verge AIGeneral AIother
Grokipedia v0.3 refreshes design and resumes edits
SpaceXAI’s Grokipedia is back from a months-long silence with a v0.3 update that prioritizes visual polish over technical breakthroughs. The new interface replaces the stark search bar with curated lists of featured and most-read articles, using a bookshelf metaphor to organize content. While the underlying AI generation engine remains unchanged, this design shift signals an attempt to make the platform feel more like a living encyclopedia than a static archive. It’s a cosmetic recovery for a project that had effectively stalled, but without new capabilities, it remains a niche experiment rather than a serious Wikipedia competitor.
The Verge AI
More in Models & Labs
© TechCrunch AIModels & Labsagents
AWS releases open-source Strands Decider 2B
Amazon’s Strands Decider 2B joins the growing wave of decision models designed to replace heavy LLMs for simple routing tasks. Built on Qwen3.5-2B, it outputs calibrated choices with confidence scores rather than generating text, offering a cheaper, faster alternative for agentic workflows. The release signals AWS’s push into specialized agent infrastructure, aiming to solve the latency and cost bottlenecks of general-purpose models. While TypeSafe’s Jev pioneered this space, Amazon’s entry brings enterprise-grade credibility and open-source accessibility to a niche that is rapidly filling with experimental clones.
TechCrunch AI
© Sam WitteveenModels & Labsmodels
Google Announces Gemini 4 Argon with 1M Token Output
Google is pushing the boundaries of context windows with Gemini 4 Argon, a new model capable of generating up to one million tokens in a single response. This isn't just about reading long documents; it's designed for complex agentic workflows where the AI must produce extensive codebases or detailed reports without truncation. Early benchmarks suggest it aims to reclaim top-tier intelligence status against competitors like GPT-6, specifically targeting tasks that require sustained reasoning and massive output generation. The shift from 64K caps to a million-token horizon fundamentally changes how developers might architect multi-step autonomous systems.
Sam Witteveen
© Wes RothModels & Labsmodels
Google Gemini 4 Argon and OpenAI DevDay announcements
Google is positioning Gemini 4 Argon as a strategic comeback model, aiming to reclaim ground in the competitive landscape. Simultaneously, OpenAI’s DevDay shifts focus from pure chat interfaces toward persistent agents with Dots and broader developer tooling. These moves signal an industry-wide pivot where AI transitions from conversational novelty to embedded utility. The real test lies in whether these new architectures deliver tangible reliability or just incremental benchmark gains.
Wes Roth