Scientists use sensors to eavesdrop on phone calls remotely


PTI, Oct 11, 2022, 1:25 PM IST

Credit: iStock Photo

Researchers have demonstrated a method to detect the vibrations of a mobile phone’s earpiece and decipher what the person on the other side of the call was saying with up to 83 per cent accuracy.

The team at Pennsylvania State University used an off-the-shelf automotive radar sensor and a novel processing approach to reveal this significant security concern.

“As technology becomes more reliable and robust over time, the misuse of such sensing technologies by adversaries becomes probable,” said Suryoday Basak, doctoral candidate at Penn State.

“Our demonstration of this kind of exploitation contributes to the pool of scientific literature that broadly says, ‘Hey! Automotive radars can be used to eavesdrop audio. We need to do something about this’,” Basak said.

The radar operates in the millimeter-wave (mmWave) spectrum, specifically in the bands of 60 to 64 gigahertz and 77 to 81 gigahertz, which inspired the researchers to name their approach “mmSpy.” This is a subset of the radio spectrum used for 5G, the fifth-generation standard for communication systems across the globe.

In the mmSpy demonstration, described in 2022 IEEE Symposium on Security and Privacy (SP), the researchers simulated people speaking through the earpiece of a smartphone.

The phone’s earpiece vibrates from the speech, and that vibration permeates across the body of the phone.

“We use the radar to sense this vibration and reconstruct what was said by the person on the other side of the line,” said Basak.

The researchers, including Mahanth Gowda, an assistant professor at Penn State, noted that their approach works even when the audio is completely inaudible to both humans and microphones nearby.

“This isn’t the first time similar vulnerabilities or attack modalities have been found, but this particular aspect — detecting and reconstructing speech from the other side of a smartphone line — was not yet explored,” Basak said.

The radar sensor data is pre-processed via MATLAB and Python modules, which are computing platform-language interfaces used to remove hardware-related and artefact noise from the data.

The researchers then feed that to machine learning modules trained to classify speech and reconstruct audio.

When the radar senses vibrations from a foot away, the processed speech is 83 per cent accuracy. That drops the farther the radar moves from the phone, down to 43 per cent accurate at six feet, they said.

Once the speech is reconstructed, the researchers can then filter, enhance or classify key words as needed, Basak said.

The team is continuing to refine their approach to better understand not only how to protect against this security vulnerability, but also how to exploit it for good.

“The methodology that we developed can also be used for sensing vibrations in industrial machinery, smart home systems and building-monitoring systems,” Basak said.

According to the researchers, there are similar home maintenance or even health monitoring systems that could benefit from such sensitive tracking.

“Imagine a radar that could track a user and call for help if some health parameter changes in a dangerous way,” Basak said.

“With the right set of target actions, radars in smart homes and industry can enable a faster turnaround when problems and issues are detected,” he added.

Udayavani is now on Telegram. Click here to join our channel and stay updated with the latest news.

Top News

Actress Kasthuri released from jail, says ‘I thank those who made me raging storm’

Kidnapped for ransom in 1998, 26/11 survivor Gautam Adani faces biggest trial

100 engineering colleges in Karnataka to be ‘adopted’ by corporates by next year: IT Minister Kharge

Siddaramaiah defends BPL ration card cancellation, says only ineligible beneficiaries affected

China announces new policy measures to protect its exports from Trump’s new tariff threat

Renovated Medical Oncology OPD and Chemotherapy Day Care Centre inaugurated at Kasturba Hospital, Manipal

Karnataka Health Minister justifies revision of user fees in state-run hospitals

Related Articles More

BTS2024: If India can make rocket sensors, it can also make car sensors, says ISRO chief Somanath

World COPD Day: Know your lung function

SpaceX successfully launches ISRO’s 4,700 kg communication satellite from US

As AI and megaplatforms take over, the hyperlinks that built the web may face extinction

Plastic waste could double by 2050, researchers find, suggest policies to address issue

MUST WATCH

Christmas Cake Fruit Mixing

DK Shivakumar

Rose Cultivation

Geethotsava

Naxal Operation


Latest Additions

Siddaramaiah says confident of winning all three bypolls in Karnataka

Hop on! IT Minister Priyank Kharge checks out Uber Shuttle at Bengaluru Tech Summit

Actress Kasthuri released from jail, says ‘I thank those who made me raging storm’

Kidnapped for ransom in 1998, 26/11 survivor Gautam Adani faces biggest trial

AIMPLB to hold its annual general sessions in Bengaluru from November 23

Thanks for visiting Udayavani

You seem to have an Ad Blocker on.
To continue reading, please turn it off or whitelist Udayavani.