TechNews

Google launches Guided Vision in Gemini Live for Android users

The camera-based feature offers spoken descriptions and prompts for everyday visual tasks. Google says access is rolling out gradually and warns against using it for navigation.

Exterior of Google's headquarters in Mountain View, California
File photograph of the exterior of Google's headquarters in Mountain View, California, taken in August 2017. David Nagle, ‘Outside Googleplex in Mountain View, California,’ via Wikimedia Commons (resized and converted to WebP). CC BY-SA 4.0.
LinkedInPostEmail
Save for later

Google announced on October 1, 2026, that Guided Vision is launching in Gemini Live on compatible Android devices. The feature lets people share their phone camera and ask spoken questions about what it shows, offering a new way for blind and low-vision users to get help with everyday visual tasks. Google describes it as an assistive tool and cautions that its answers can be wrong.

During a Gemini Live conversation, a user can point the camera at an object or scene and ask for a description. Google says Guided Vision can also give spoken prompts when the camera is too high, too close or pointed away from what the user wants to examine. Those prompts are intended to help the user adjust the camera so the system has a clearer view before answering.

What Guided Vision can help users examine

Google lists reading small food labels, appliance displays and menus among the intended uses. It also describes finding an object such as a dropped earbud, locating pepper in a crowded cabinet, identifying colors or patterns in clothing, and describing a room’s layout. These are examples of what Google says the feature is designed to do, rather than results from an independent assessment of its performance.

The company says Guided Vision supports conversations in multiple languages. Google reports testing descriptions, answers and camera-adjustment prompts with blind and low-vision communities in countries including India, Brazil, Singapore and Indonesia. It has not provided independent user outcome data in the launch announcement, so the extent to which the feature works reliably across those tasks and settings remains unestablished by the cited announcement.

Google says it worked with visual assistance provider Aira while developing Guided Vision. According to the company, the partnership involved tens of thousands of hours of visually interpreted data, more than 1,000 members of Aira’s Trusted Tester network, and Aira specialists who helped its teams establish and evaluate safety guardrails. Those figures describe Google’s reported development process; they are not a published measure of accuracy for people using the launched feature.

How Android users can access Guided Vision

Google says Guided Vision is available for devices running Android 9 or later in regions and languages where Gemini Live is supported. Users can turn on ‘Use Guided Vision in Live’ in the Gemini app’s settings, start a Live conversation and share the camera. Google advises updating both the Gemini app and Android software. Its Android Accessibility Help page adds a practical qualification: the feature is rolling out slowly, so an otherwise eligible user may not see it yet.

Android accessibility settings also offer shortcuts for starting the feature, including an accessibility button, a gesture or the volume keys, according to Google. People using TalkBack, Android’s screen reader, can select Guided Vision from the TalkBack menu. These routes matter because the feature is meant to provide spoken assistance, including when someone needs help framing the camera before the system can describe what is in view.

What earlier research says about AI visual assistance

Research about other visual assistance tools helps explain the need for careful choices about when to use AI. In a 2023 survey described by the American Foundation for the Blind’s AccessWorld publication, the National Research and Training Center on Blindness and Low Vision collected responses from 325 people who were blind, legally blind or had low vision. About 64% said they used a remote sighted-assistance app at least monthly. The survey preceded Guided Vision and did not evaluate it.

Among 194 respondents who answered questions about app use, 45.4% rated remote sighted-assistance apps very important or essential to their daily functioning. Asked about a preference for human or AI assistance, 69.2% of surveyed app users said it depended on the task; 28.2% preferred human assistance and 2.6% preferred AI assistance. Those responses concern the tools available to participants at the time, rather than a judgment on Google’s new feature.

The AccessWorld account also reports that 98.7% of 76 respondents who commented after trying Be My AI expressed a positive opinion. Some respondents nevertheless described AI help as inconsistent or less versatile than a human assistant, and some raised concerns about trust and privacy. The responses were collected in 2023, when Be My AI used GPT-4. They show differing experiences with an earlier service, not evidence that Guided Vision will deliver the same results.

Where Google draws the safety line

Google explicitly warns that Guided Vision can make mistakes. It says the feature is not a medical device, a mobility aid or a replacement for a white cane or established safe-travel practices. The company tells users not to rely on it for navigation or obstacle detection. That distinction is consequential: describing a label or a nearby object is among its stated uses, while guiding someone safely through a physical environment is outside them.

For now, the established change is the launch and gradual availability of a camera-based, conversational feature on supported Android devices. Google’s announcement explains its intended uses and its limits, but does not give an end date for the rollout or independent measurements of real-world accuracy. Users who cannot yet find the setting have Google’s warning that access is arriving over time; those who can use it have the company’s instruction to treat its descriptions as fallible.

Sources and context

AI-assisted article checked against the listed sources. NewsJaws did not conduct interviews or attend the reported events.

About NewsJaws Desk

AI-assisted reporting and explainers reviewed against the linked source documents. No claim of on-scene reporting or original interviews.