Guided Vision is being introduced today as part of the Gemini Live app on selected Android devices, utilizing artificial intelligence to provide real-time audio descriptions of various objects viewed through your phone’s camera. By enabling camera access within the Gemini Live application, users can receive AI assistance in tasks such as reading small text, identifying surroundings, or detailing specific items.
This feature resembles the VoiceOver Live Recognition function integrated by Apple into its iPhone and Vision Pro products. It aims to assist individuals who are blind, have low vision, or require help in certain scenarios. Aside from the Gemini app, Guided Vision will also be available via Google TalkBack. Users can conveniently configure an accessibility shortcut for this feature in the settings menu on devices operating on Android 9 and later, following its announcement in a recent suite of updates for Pixel devices.
Users can engage with Gemini Live by asking follow-up queries about items they are examining, such as requesting it to read the expiration date of a product. The AI will also provide audio cues to assist in aligning the camera with the desired object, even if it’s not currently in the frame. Nevertheless, Google advises that users should not depend on Guided Vision for activities such as navigation, safe travel guidance, or obstacle detection, and it should never replace mobility aids like canes.
Editor’s Take
The launch of Guided Vision in Gemini Live represents a significant advancement in accessible technology, enhancing the capabilities available to those with visual impairments. With real-time assistance now embedded in everyday devices, this development highlights the ongoing commitment of companies like Google to foster inclusivity. Moreover, it opens new avenues for innovations in AI that could benefit various industries and empower users to navigate their environments more confidently.
Source: www.theverge.com
