advertisement

Follow Mint Lounge

Latest Issue

| Log In / Register

Home > Smart Living> Innovation > How Google's Lookout app helps users with low vision

How Google's Lookout app helps users with low vision

Google recently announced a host of new Android accessibility services and features, including handwriting recognition on the Lookout app 

In this file photo taken on February 25, 2019 visitors walk past the Android stand at the Mobile World Congress in Barcelona. Earlier this week, Google announced some new Android features that would help users do more with their phones.
In this file photo taken on February 25, 2019 visitors walk past the Android stand at the Mobile World Congress in Barcelona. Earlier this week, Google announced some new Android features that would help users do more with their phones. (AFP)

Earlier this week, Google announced some new Android features that would help users do more with their phones. Keeping in mind people with motor and speech disabilities, Google announced “Camera Switches” and “Project Activate” -- two new accessibility features that let you use your phone by making facial gestures. Camera Switches is essentially a feature within the Android Accessibility Suite that turns your phone’s front-facing camera into a switch that replaces a keyboard, mouse, or touchscreen, so that you can navigate your phone. 

advertisement

advertisement

Project Activate is a new app that makes it easier for users to communicate. Users can use facial gestures and eye movements to activate preset actions like speaking a phrase (such as "Wait!"), playing audio (like a laugh) or sending a text message (like "Please come here"), a blogpost on the Keyword blog explains.

MORE FROM THIS SECTION

view all

Also read: Niagara Launcher is a minimalist Android home screen delight

But some other new accessibility features that will be rolled out to Android devices are on the Google Lookout app. First launched in 2019 and updated further in August 2020, Lookout by Google uses computer vision to assist people with low vision or blindness get things done faster and more easily. The app is available in more than 20 languages. Lookout uses your phone’s camera to get more information about the world around you and do daily tasks more efficiently -- everything from sorting mail, putting away groceries, etc. Lookout draws upon similar underlying technology as Google Lens, which lets users search and take actions on the objects around them, simply by pointing their phone.

advertisement

advertisement

The Google Lookout app has five modes that cover almost a host of daily activities.
The Google Lookout app has five modes that cover almost a host of daily activities.

The app has five modes that cover almost a host of daily activities. Using “Food Labels” mode, users can quickly identify packaged foods by their label, in addition to scanning barcodes. This feature is available in more than 20 countries.

Documents mode helps a user read a whole page of text. You can take a photo of a document, and Lookout will scan the text, so that it can be read aloud by your screen reader or magnified on your phone. Among the new features announced this week, is handwriting recognition on the Lookout app. In Documents mode, Lookout will now read out both handwritten and printed text for Latin-based languages, the Keyword blog explains.

advertisement

advertisement

There’s also “Text” mode to quickly skim text and hear it read aloud. “Currency” mode can be used to identify banknotes quickly and reliably, with support for US dollars, and now for Indian Rupees, and Euros as well. According to the blog, the addition of the Indian Rupee and the Euro to currency mode is in response to Lookout’s growing global audience, with more currencies set to be added in the future.

Also read: This Android app promises you hassle-free offline reading

MORE FROM THIS SECTION

view all

Next Story

advertisement