Digital Mask to Protect Patients’ Privacy

It will prevent patients’ sensitive personal biometric information from being extracted and shared.

Image credit: Professor Haotian Lin's research group

Scientists have created a ‘digital mask that will allow facial images to be stored in medical records while preventing potentially sensitive personal biometric information from being extracted and shared. In a research published in Nature Medicine in September, a team led by scientists from Cambridge and China used three-dimensional (3D) reconstruction and deep learning algorithms to erase identifiable features from facial images while retaining disease-relevant features needed for diagnosis.

Facial images can be useful for identifying signs of disease. For example, features such as deep forehead wrinkles and wrinkles around the eyes are significantly associated with coronary heart disease, while abnormal changes in eye movement can indicate poor visual function and visual cognitive developmental problems. However, facial images also inevitably record other biometric information about the patient, including their race, sex, age, and mood.

With the increasing digitalization of medical records comes the risk of data breaches. While most patient data can be anonymized, facial data is more difficult to anonymize while retaining essential information. Common methods, including blurring and cropping identifiable areas, may lose important disease-relevant information, yet even so cannot fully evade face recognition systems, reports the University of Cambridge. Due to privacy concerns, people often hesitate to share their medical data for public medical research or electronic health records, hindering the development of digital medical care.

“During the COVID-19 pandemic, we had to turn to consultations over the phone or by video link rather than in person. Remote healthcare for eye diseases requires patients to share a large amount of digital facial information. Patients want to know that their potentially sensitive information is secure and that their privacy is protected,” said Professor Haotian Lin, Sun Yat-sen University, Guangzhou, China.

Professor Lin and colleagues developed a digital mask, which inputs an original video of a patient’s face and outputs a video based on the use of a deep learning algorithm and 3D reconstruction while discarding as much of the patient’s personal biometric information as possible – and from which it was not possible to identify the individual.

Deep learning extracts features from different facial parts, while 3D reconstruction automatically digitizes the shapes and movement of 3D faces, eyelids, and eyeballs based on the extracted facial features. Converting the digital mask videos back to the original videos is extremely difficult because most of the necessary information is no longer retained in the mask. Next, the researchers tested how useful the masks were in clinical practice and found that diagnosis using the digital masks was consistent with that carried out using the original videos. This suggests that the reconstruction was precise enough for use in clinical practice.

Read more: This Wearable Face Mask Diagnoses COVID-19 And Alerts The Wearer

Compared to the traditional method used to "de-identify" patients – cropping the image – the risk of being identified was significantly lower in the digitally-masked patients. The researchers tested this by showing 12 ophthalmologists digitally masked or cropped images and asking them to identify the original from five other images. They correctly identified the original from the digitally-masked image in just over a quarter(27%) of cases; for the cropped figure, they were able to do so in the overwhelming majority of cases (91%). This is likely to be an overestimation, however: in real situations, one would likely have to identify the original image from a much larger set.

The team surveyed randomly selected patients attending clinics to test their attitudes towards digital masks. Over 80% of patients believed the digital mask would alleviate their privacy concerns and they expressed an increased willingness to share their personal information if such a measure was implemented. Finally, the team confirmed that the digital masks can also evade artificial intelligence-powered facial recognition algorithms.

Professor Patrick Yu-Wai-Man from the University of Cambridge said: “Digital masking offers a pragmatic approach to safeguarding patient privacy while still allowing the information to be useful to clinicians. At the moment, the only options available are crude, but our digital mask is a much more sophisticated tool for anonymizing facial images. "This could make telemedicine – phone and video consultations – much more feasible, making healthcare delivery more efficient. If telemedicine is to be widely adopted, then we need to overcome the barriers and concerns related to privacy protection. Our digital mask is an important step in this direction.”

The research was a collaboration led by scientists from the Zhongshan Ophthalmic Center, Sun Yat-sen University in Guangzhou; Tsinghua University in Beijing, China; and the University of Cambridge.

Jürgen Thalmayer
October 4, 2022

Innovation of the Month

Do you want to discover more, visit the website
Visit Website

Other news

ICFO Develops Graphene-Based Wearable Health Monitoring Devices

The number of different graphene-based wearable prototypes emerging today is growing rapidly.

Teladoc to Integrate Microsoft AI in its Healthcare Platform

Teladoc Health announced its collaboration with Microsoft to integrate Microsoft AI in its platform.

Galaxy Wear App Update Reveals Samsung Is Working On Galaxy Buds Pro Successor

With the Galaxy Wearable App, Samsung has a central solution for all of the manufacturer's wear...

Global 3D Printed Wearables Market Size Expected to Reach USD 5.5 Billion by 2027

The global 3D printed wearables market size is expected to reach USD 5.5 billion by 2027...
Discover more