Smart glasses that play a specific noise when an object comes into their field of view, such as the sound of a page turning to represent a book, enable people who are blind to locate that item
By Chen Ly
25 October 2023
A person who is blind can detect a bowl is in front of them while wearing a pair of smart glasses
LIL DEVERELL/UNIVERSITY OF TECHNOLOGY SYDNEY, AUSTRALIA, CC-BY 4.0
Smart glasses that emit a sound when an object comes into their field of view could help people who are blind to locate certain items.
Some people who are blind can be trained to move via echolocation. This involves them sending out a noise that bounces off objects in their vicinity, with the returning echoes giving information about their surrounding area.
Inspired by this ability, Howe Zhu at the University of Technology Sydney in Australia and his colleagues wanted to create glasses that similarly give people information about what objects are close to them. “We wanted to help blind people navigate in a much more fluent manner,” says Zhu.
Advertisement
The researchers first took a pair of augmented-reality glasses with two front-facing cameras and built-in speakers. They then designed a smartphone app that used deep learning to process the visual information captured by the glasses to identify four objects: a bowl, cup, book and bottle.
The team programmed a sound to play from the speakers when one of the objects came into the glasses’ field of view as a wearer scanned their head around a room. Each of the objects was assigned a corresponding sound. For example, when a book came into view, the wearer heard a page turning.
To test the glasses, the team enlisted seven people with varying degrees of light perception and seven people with no sight issues who were blindfolded. They were all sat at a table with the four objects arranged on top.