Google listens to conversations recorded by its smart home devices
Share article:
Share article:

Google listens to conversations recorded by its smart home devices

Belgium's privacy watchdog said it will "probably" investigate Google's use of recordings stored by its smart home appliances. Credit: Pixabay

Google hires people to listen to recordings and conversations of users of the tech company’s smart home devices and applications, with some of those recordings collected without users’ consent, according to reports by VRT on Wednesday.

An anonymous subcontractor of the global tech giant gave the Flemish news site access to over a thousand conversations recorded via the Google Home smart speakers or the Google Assistant smartphone app — out of which 153 were recorded unbeknownst to the user.

That external employee was one of many hired by Google worldwide, including in Belgium, to listen back and analyze a series of recordings captured and stored by the smart assistants on Crowdsource, a platform on which anyone can help improve the company’s algorithms by describing images, audio snippets, videos…

Recordings captured by the smart devices are kept in a “hidden” area of the platform accessible only to authorised personnel, according to the outlet. The employee’s job is to “process” the recordings in order to help improve the device’s understanding of the intricacies of the human language.

“Employees must listen carefully to describe the fragment as well as possible,” the outlet writes, adding that the subcontractors are asked to describe the snipped in detail: “Can you hear a female voice, or a male voice. Is it a child? What is being said? Every cough and audible comma is written out.”

‘That is unquestionably my own voice’

The audio fragments captured and stored by the appliances are reportedly stripped of all information which may help the employee’s listening back on them to identify the persons behind them. User names and other information are stripped out of the audio files.

But a crucial part of the employee’s tasks is to help the devices make out words that it was not able to understand or process by itself, meaning “employees who listen must search every word, address, name or company name” for which the spelling is uncertain, potentially facilitating the task of completely or partially identifying the person speaking.

Some fragments that VRT listened to allowed the outlet to find and track down the users and pay them a visit in their own homes to playback the recordings for them.

“That is unquestionably my own voice,” one Flanders resident said upon listening to an audio fragment, while a couple in the town of Waasmunster said they “immediately” recognised the voices of their children and grandchildren.

Hearing problems

Most of the audio snippets the Dutch-language news site examined stemmed from users’ direct interaction with the smart appliances, resulting from the specific vocal command “Ok Google.”

According to the outlet, the smart speaker’s small print states that the recording and storing of these audio fragments is an option turned on by default — but that the fine print does not say that people will listen back on them.

But this includes only the voice recordings that are captured after the user pronounces the command “Ok Google,” yet the VRT said over a hundred fragments it was given access to were recorded unknowingly, because the smart appliances are activated by any word that “sounds like Google,” or whenever the user “accidentally pushes a button” or “unknowingly gives a command.”

The thousands of conversations analyzed by the outlet included bedroom conversations, conversations between parents and children but also “banging arguments” and “business phone conversations with a lot of confidential information.”

High tech trumps privacy

The findings of the Flemish outlet follow reports by Bloomberg in April that Amazon employees were also reviewing conversations and recordings stored by the company’s own smart home assistant, Alexa.

Like Google’s subcontractors, Amazon’s clock in the world over to listen to thousands of different recordings and conversations as a way to improve the companies’ smart appliances and beef up their algorithms, the key to their success.

In the case of Google, the company has published a series of videos aiming to fight back against concerns that it was eavesdropping.

Contacted by VRT about the recordings it obtained, the company acknowledged that it reviewed fragments to improve its technology but that it concerned only a small number of clips, which make up “only 0.2% of all audio clips.”

The company further stated that the work carried out by its subcontractors was “crucial for the development of technology that makes products such as the Google Assistant possible,” raising the question which has plagued Google, Facebook and the world’s other tech giants since they first rolled-out their high-performing products: how far can technology overstep the boundaries of privacy?

Gabriela Galindo
The Brussels Times

Latest news

Intervention hotline 1722 activated following bad weather warnings
Following bad weather warnings from Belgium's Royal Meteorological Institute of Belgium (RMI), the Federal Public Service (FPS) Home Affairs has ...
Thousands march in Brussels to raise awareness of violence against women
More than 3,000 people took to the streets of Brussels on Sunday afternoon for a national march to raise awareness of violence against women in ...
Efficacy of vaccines against new variant known in a few weeks, virologist says
The efficacy of the current coronavirus vaccines against the new Omicron variant will be clear in one to two weeks, Belgian virologist Marc Van Ranst ...
Scientists could have communicated better during pandemic, survey shows
The majority of Flemish people continue to trust scientists, however, only half of them feel scientists communicated understandably during the ...
Closing borders and new travel restrictions: Countries react to Omicron variant
As more cases of the new Omicron variant of the coronavirus are being reported across the world, more and more countries are imposing tougher travel ...
Several rush hour train services to be scrapped from Monday
Up to ten peak time trains to and from Brussels will be temporarily cancelled starting from Monday, Belgian railway company SNCB announced this ...
Europe’s largest vintage clothes store is in Ghent this weekend
Europe's largest pop-up store for second-hand clothes is once again setting up shop in Ghent on Sunday, offering more than five tonnes of vintage ...
Animal welfare in EU’s pig meat sector: What’s wrong?
EU has put into place legislation to ensure that animal welfare conditions are respected in its agricultural policy but the breaches of its ...
‘Not feasible’: Doctors refuse to follow new testing strategy
Doctors have warned they will not follow the government's adapted testing strategy which would see vaccinated people who were in close contact with a ...
Flanders introduces ‘invisible’ speed cameras
New digital speed cameras that are essentially invisible to the road user are being introduced on various roads and motorways in Flanders, Flemish ...
Warnings issued for slippery roads across Belgium
Drivers have been asked to watch out for slippery roads from Saturday afternoon until Sunday evening, as snow and cold temperatures are expected ...
Testing rules following high-risk contact eased for vaccinated people
The coronavirus testing policy following a high-risk contact has been eased, meaning a vaccinated person who was in contact with an infected person ...