Your robot vacuum cleaner could be picking up private conversations along with the dust and dirt in your home.

Computer scientists from the National University of Singapore (NUS) have shown how a common robot vacuum cleaner and its built-in light detection and ranging (Lidar) sensor could be used to “spy” on private conversations, the university said on Monday

An NUS research team led by Assistant Professor Jun Han has shown that the Lidar sensor on a robot vacuum cleaner can be repurposed as a tool to spy on private conversations at home or in the office. Photo: NUS handout

The method, called LidarPhone, repurposes the Lidar sensor that a robot vacuum cleaner normally uses for navigating around a home into a laser-based microphone to eavesdrop on private conversations.

The research team, led by Assistant Professor Jun Han and his doctoral student Sriram Sami, managed to recover speech data with “high accuracy”, NUS said.

“The proliferation of smart devices – including smart speakers and smart security cameras – has increased the avenues for hackers to snoop on our private moments,” said Mr Sami.

”Our method shows it is now possible to gather sensitive data just by using something as innocuous as a household robot vacuum cleaner. Our work demonstrates the urgent need to find practical solutions to prevent such malicious attacks.”

The core of the LidarPhone “attack method” is the Lidar sensor, a device which emits an invisible scanning laser to create a map of its surroundings.

The research showed that by reflecting lasers off common objects, such as a dustbin or a takeaway bag located near a person’s computer speaker or television soundbar, hackers could obtain information about the original sound that made the objects’ surfaces vibrate.

“Using applied signal processing and deep learning algorithms, speech could be recovered from the audio data, and sensitive information could potentially be obtained,” NUS said.

Yes, your smart home devices are listening to you
13 Oct 2020


In their experiments, the researchers used a common robot vacuum cleaner with two sources of sound – the voice of a person reading out numbers played from a computer speaker and music clips from television shows played through a television soundbar.

The team collected more than 19 hours of recorded audio files and passed them through “deep learning algorithms” that were trained to either match human voices or identify musical sequences.

“The system was able to detect the digits being spoken aloud, which could constitute a victim’s credit card or bank account numbers. Music clips from television shows could potentially disclose the victim’s viewing preferences or political orientation,” NUS said.

The system achieved a classification accuracy rate of 91 per cent when recovering spoken digits and a 90 per cent accuracy rate when classifying music clips. These results are “significantly higher” than a random guess of 10 per cent, NUS said.

The NUS scientists also experimented with common household materials to test how well they reflected the Lidar laser beam and found that the accuracy of audio recovery varied between different materials – the best material for reflecting the laser beam was a glossy polypropylene bag, while the worst was glossy cardboard.

NUS students Dai Yimin and Sean Tan Rui Xiang, as well as Assistant Professor Nirupam Roy from the University of Maryland, contributed to the research. The research was presented at the Association for Computing Machinery’s Conference on Embedded Networked Sensor Systems (SenSys 2020) on November 18, where the team clinched the Best Poster Runner Up Award.

To prevent Lidars from being misused, people with robot vacuum cleaners are advised to not connect them to the Internet.

The NUS team also recommends that Lidar sensor manufacturers incorporate a mechanism that cannot be overridden to prevent the internal laser from firing when the Lidar is not rotating.

Did Amazon Echo personal assistant witness murder?
20 Jul 2018



“In the long term, we should consider whether our desire to have increasingly ‘smart’ homes is worth the potential privacy implications,” said Assistant Professor Han. “We might have to accept that each new Internet-connected sensing device brought into our homes poses an additional risk to our privacy, and make our choices carefully.”

The team is working on applying these LidarPhone findings to autonomous vehicles, which also use Lidar sensors. This technology could be used to eavesdrop on conversations happening in nearby cars through minute vibrations of the windows, NUS said.

The researchers are also looking into the vulnerability of active laser sensors found on the latest smartphones, which could reveal further privacy issues, the university added.

Read the original story at Today Online