On October 1, Google added Guided Vision, an accessibility feature for blind and low-vision users, to Gemini Live, the real-time conversation mode of its Gemini AI assistant. It uses the phone camera to describe surroundings by voice, so users can check small print or find objects by talking it through. It supports Android 9 and later and can also be launched from TalkBack.

Describing the Surroundings Through the Camera

When a user shares the camera in Gemini Live, Guided Vision has the AI describe what is in front of it. Users can then ask follow-up questions, such as "Tell me more" or "What is on the right?"

When the camera angle or distance is off, the AI also gives spoken cues for repositioning, such as moving closer. Framing a shot without sight is hard, so this guidance matters in practice.

Intended Uses

The use cases Google lists are mostly everyday, small tasks.

Examples include reading ingredient lists on food packaging or tiny text on appliance dials. It is also meant for finding misplaced items, locating something on a shelf, checking the color or pattern of clothing, and getting a sense of an unfamiliar room's layout.

Conversations can be held in multiple languages. Availability follows the regions and languages supported by Gemini Live.

Requirements and How to Turn It On

The feature began rolling out on October 1 and supports devices running Android 9 or later.

There are three ways to enable it. The first is to switch on "Use Guided Vision in Live" in the profile settings of the Gemini app. The second is to open it from the accessibility shortcuts in Android settings. The third is to start it from the TalkBack three-finger tap menu, which lets existing screen reader users begin from familiar gestures.

Tuned in Collaboration With Aira

Aira, a service that provides visual assistance for blind users, helped with development. The model reportedly draws on tens of thousands of hours of Aira's visual interpretation data, and more than 1,000 members of Aira's Trusted Tester network helped refine it.

That testers with lived experience tried it in real use is worth noting when judging how practical the feature is.

Limits to Know Before Using It

Google states that Guided Vision should not be relied on for walking navigation, obstacle detection, or safe-travel guidance, and that it does not replace a white cane or other mobility aids. The AI can make mistakes, and it is not a medical device.

It is best treated as an extra pair of eyes for hard-to-see information, with safety-related decisions still made using established methods.

Summary

Guided Vision adapts Gemini Live's camera sharing for blind and low-vision users. Since October 1 it has been available on Android 9 and later, in the regions and languages where Gemini Live is supported. It can help with everyday tasks such as reading labels and finding items, but it is not meant to ensure safety while moving. Because it can be launched from TalkBack and the accessibility shortcuts, a good first step is to try it on simple reading tasks.