Google has officially introduced Guided Vision, a new feature integrated into Gemini Live for Android devices. The tool utilizes camera input to provide real-time audio descriptions of objects, text, and surroundings. It is designed to assist users who are blind or have low vision by identifying items or reading small print.
The functionality is accessible through the Gemini app, Google TalkBack, or via a custom accessibility shortcut in the Android settings menu. The feature is compatible with devices running Android 9 or newer. Users can also ask follow-up questions, such as inquiring about expiration dates on products identified by the AI.
To improve usability, the system provides audio cues to help users align their camera if an object is not initially in the frame. Google explicitly states that Guided Vision should not be used for navigation, obstacle detection, or as a substitute for traditional mobility aids like canes.
