{"id":253,"date":"2020-10-11T17:00:21","date_gmt":"2020-10-11T17:00:21","guid":{"rendered":"https:\/\/thenextweb.com\/?p=1322335"},"modified":"2020-10-11T17:00:21","modified_gmt":"2020-10-11T17:00:21","slug":"how-facial-recognition-systems-are-adapting-to-masks","status":"publish","type":"post","link":"https:\/\/www.londonchiropracter.com\/?p=253","title":{"rendered":"How facial recognition systems are adapting to masks"},"content":{"rendered":"\n<p>It\u2019s surprising how quickly public opinion can change. Winding the clocks back 12 months, many of us would have looked at a masked individual in public with suspicion.<\/p>\n<p>Now, some countries have enshrined face mask use <a href=\"https:\/\/www.aljazeera.com\/news\/2020\/04\/countries-wearing-face-masks-compulsory-200423094510867.html\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">in law<\/a>. They\u2019ve also been made <a href=\"https:\/\/www.health.gov.au\/news\/health-alerts\/novel-coronavirus-2019-ncov-health-alert\/how-to-protect-yourself-and-others-from-coronavirus-covid-19\/masks\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">compulsory in Victoria<\/a> and are recommended in several other states.<\/p>\n<p>One consequence of this is that facial recognition systems in place for security and crime prevention may no longer be able to fulfil their purpose. In Australia, most agencies are silent about the use of facial recognition.<\/p>\n<p>But documents leaked earlier this year revealed <a href=\"https:\/\/www.buzzfeednews.com\/article\/ryanmac\/clearview-ai-fbi-ice-global-law-enforcement\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Australian Federal Police<\/a> and state police in <a href=\"https:\/\/theconversation.com\/australian-police-are-using-the-clearview-ai-facial-recognition-system-with-no-accountability-132667\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Queensland, Victoria and South Australia<\/a> all use Clearview AI, a commercial facial recognition platform. New South Wales police <a href=\"https:\/\/www.abc.net.au\/news\/2020-01-23\/australian-founder-of-clearview-facial-recognition-interview\/11887112\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">also admitted<\/a> using a biometrics tool called PhotoTrac.<\/p>\n<h2>What is facial recognition?<\/h2>\n<p><a href=\"https:\/\/us.norton.com\/internetsecurity-iot-how-facial-recognition-software-works.html\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Facial recognition<\/a> involves using computing to identify human faces in images or videos, and then measuring specific facial characteristics. This can include the distance between eyes, and the relative positions of the nose, chin and mouth.<\/p>\n<p>This information is combined to create a <a href=\"https:\/\/www.eff.org\/pages\/face-recognition\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">facial signature, or profile<\/a>. When used for individual recognition \u2013 such as to unlock your phone \u2013 an image from the camera is compared to a recorded profile. This process of facial \u201cverification\u201d is relatively simple.<\/p>\n<p>However, when facial recognition is used to identify faces in a crowd, it requires a significant database of profiles against which to compare the main image.<\/p>\n<p>These profiles can be legally collected by enrolling large numbers of users <a href=\"https:\/\/immi.homeaffairs.gov.au\/help-support\/meeting-our-requirements\/biometrics\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">into systems<\/a>. But they\u2019re sometimes collected through <a href=\"https:\/\/news.miami.edu\/stories\/2020\/02\/new-facial-recognition-software-scrapes-inventory-from-social-media.html\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">covert means<\/a>.<\/p>\n<figure class=\"align-center \" readability=\"4\">\n<p><figure class=\"post-image post-mediaBleed aligncenter\"><img decoding=\"async\" loading=\"lazy\" src=\"https:\/\/images.theconversation.com\/files\/353221\/original\/file-20200817-24-10qf4oa.png?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=754&amp;fit=clip\" sizes=\"(min-width: 1466px) 754px, (max-width: 599px) 100vw, (min-width: 600px) 600px, 237px\" alt width=\"600\" height=\"500\" class=\" lazy\" data-lazy=\"true\" data-srcset=\"https:\/\/images.theconversation.com\/files\/353221\/original\/file-20200817-24-10qf4oa.png?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=600&amp;h=500&amp;fit=crop&amp;dpr=1 600w, https:\/\/images.theconversation.com\/files\/353221\/original\/file-20200817-24-10qf4oa.png?ixlib=rb-1.1.0&amp;q=30&amp;auto=format&amp;w=600&amp;h=500&amp;fit=crop&amp;dpr=2 1200w, https:\/\/images.theconversation.com\/files\/353221\/original\/file-20200817-24-10qf4oa.png?ixlib=rb-1.1.0&amp;q=15&amp;auto=format&amp;w=600&amp;h=500&amp;fit=crop&amp;dpr=3 1800w, https:\/\/images.theconversation.com\/files\/353221\/original\/file-20200817-24-10qf4oa.png?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=754&amp;h=628&amp;fit=crop&amp;dpr=1 754w, https:\/\/images.theconversation.com\/files\/353221\/original\/file-20200817-24-10qf4oa.png?ixlib=rb-1.1.0&amp;q=30&amp;auto=format&amp;w=754&amp;h=628&amp;fit=crop&amp;dpr=2 1508w, https:\/\/images.theconversation.com\/files\/353221\/original\/file-20200817-24-10qf4oa.png?ixlib=rb-1.1.0&amp;q=15&amp;auto=format&amp;w=754&amp;h=628&amp;fit=crop&amp;dpr=3 2262w\"><figcaption><a href=\"https:\/\/thenextweb.com\/neural\/2020\/10\/11\/how-facial-recognition-systems-are-adapting-to-masks-syndication\/#\" data-url=\"https:\/\/twitter.com\/intent\/tweet?url=https%3A%2F%2Fthenextweb.com%2Fneural%2F2020%2F10%2F11%2Fhow-facial-recognition-systems-are-adapting-to-masks-syndication%2F&amp;via=thenextweb&amp;related=thenextweb&amp;text=Check out this picture on: Facial \u2018verification\u2019 (the method used to unlock smartphones) compares the main image with a single pre-saved facial signature. Facial \u2018identification\u2019 requires examining the image against an entire database of facial signatures. teguhjatipras\/pixabay\" data-title=\"Share Facial \u2018verification\u2019 (the method used to unlock smartphones) compares the main image with a single pre-saved facial signature. Facial \u2018identification\u2019 requires examining the image against an entire database of facial signatures. teguhjatipras\/pixabay on Twitter\" data-width=\"685\" data-height=\"500\" class=\"post-image-share popitup\" title=\"Share Facial \u2018verification\u2019 (the method used to unlock smartphones) compares the main image with a single pre-saved facial signature. Facial \u2018identification\u2019 requires examining the image against an entire database of facial signatures. teguhjatipras\/pixabay on Twitter\"><i class=\"icon icon--inline icon--twitter--dark\"><\/i><\/a>Facial \u2018verification\u2019 (the method used to unlock smartphones) compares the main image with a single pre-saved facial signature. Facial \u2018identification\u2019 requires examining the image against an entire database of facial signatures. teguhjatipras\/pixabay<\/figcaption><\/figure>\n<\/p>\n<\/figure>\n<h2>The problem with face masks<\/h2>\n<p>As facial signatures are based on mathematical models of the relative positions of facial features, anything that reduced the visibility of key characteristics (such as the nose, mouth and chin) interferes with facial recognition.<\/p>\n<p>There are already many ways to <a href=\"https:\/\/www.businessinsider.com.au\/clothes-accessories-that-outsmart-facial-recognition-tech-2019-10\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">evade or interfere<\/a> with facial recognition technologies. Some of these evolved from techniques designed to evade number plate recognition systems.<\/p>\n<p>Although the coronavirus pandemic has escalated concerns around the evasion of facial recognition systems, <a href=\"https:\/\/theintercept.com\/2020\/07\/16\/face-masks-facial-recognition-dhs-blueleaks\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">leaked US documents<\/a> show these <a href=\"https:\/\/www.documentcloud.org\/documents\/6989376-U-FOUO-in-Violent-Adversaries-Likely-to-Use.html\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">discussions<\/a> taking place back in 2018 and 2019, too.<\/p>\n<figure><iframe loading=\"lazy\" src=\"https:\/\/www.youtube.com\/embed\/Xpu2MSmZkmU?wmode=transparent&amp;start=0\" width=\"440\" height=\"260\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\">[embedded content]<\/iframe><\/figure>\n<p>And while the debate on the <a href=\"https:\/\/theconversation.com\/large-scale-facial-recognition-is-incompatible-with-a-free-society-126282\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">use<\/a> and <a href=\"https:\/\/theconversation.com\/facial-recognition-technology-is-expanding-rapidly-across-australia-are-our-laws-keeping-pace-141357\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">legality<\/a> of facial recognition continues, the focus has recently shifted to the challenges presented by mask-wearing in public.<\/p>\n<p>On this front, the US National Institute of Standards and Technology (NIST) coordinated a <a href=\"https:\/\/www.nist.gov\/news-events\/news\/2020\/07\/nist-launches-studies-masks-effect-face-recognition-software\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">major research project<\/a> to evaluate how masks impacted the performance of various facial recognition systems used across the globe.<\/p>\n<p>Its <a href=\"https:\/\/nvlpubs.nist.gov\/nistpubs\/ir\/2020\/NIST.IR.8311.pdf\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">report<\/a>, published in July, found some algorithms struggled to correctly identify mask-wearing individuals <a href=\"https:\/\/www.vox.com\/recode\/2020\/7\/28\/21340674\/face-masks-facial-recognition-surveillance-nist\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">up to 50% of the time<\/a>. This was a significant error rate compared to when the same algorithms analysed unmasked faces.<\/p>\n<p>Some algorithms even <a href=\"https:\/\/edition.cnn.com\/2020\/07\/28\/tech\/face-masks-facial-recognition\/index.html\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">struggled to locate a face<\/a> when a mask was covering too much of it.<\/p>\n<h2>Finding ways around the problem<\/h2>\n<p>There are currently no usable photo data sets of mask-wearing people that can be used to train and evaluate facial recognition systems.<\/p>\n<p>The NIST study addressed this problem by <a href=\"https:\/\/www.theverge.com\/2020\/7\/28\/21344751\/facial-recognition-face-masks-accuracy-nist-study\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">superimposing<\/a> masks (of various colors, sizes and positions) over images of faces, as seen here:<\/p>\n<div data-react-class=\"Tweet\" data-react-props=\"{&quot;tweetId&quot;:&quot;1287876259586822144&quot;}\" readability=\"10.747826086957\">\n<blockquote class=\"twitter-tweet\" readability=\"7.2099447513812\">\n<p dir=\"ltr\" lang=\"en\">Researchers from NIST found that face masks are causing facial recognition algorithms to fail as frequently as 50% of the time.<a href=\"https:\/\/t.co\/ukFMc36L2P\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">https:\/\/t.co\/ukFMc36L2P<\/a><\/p>\n<p>\u2014 CNET (@CNET) <a href=\"https:\/\/twitter.com\/CNET\/status\/1287876259586822144?ref_src=twsrc%5Etfw\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">July 27, 2020<\/a><\/p>\n<\/blockquote>\n<p>While this may not be a realistic portrayal of a person wearing a mask, it\u2019s effective enough to study the effects of mask-wearing on facial recognition systems.<\/p>\n<\/div>\n<p>It\u2019s possible images of real masked people would allow more details to be extracted to improve recognition systems \u2013 perhaps by estimating the nose\u2019s position based on visible protrusions in the mask.<\/p>\n<p>Many facial recognition technology vendors are already <a href=\"https:\/\/www.cnet.com\/health\/facial-recognition-firms-are-scrambling-to-see-around-face-masks\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">preparing for<\/a> a future where mask use will continue, or even increase. <a href=\"https:\/\/www.dezeen.com\/2020\/02\/27\/face-recognition-masks-resting-risk-face\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">One US company<\/a> offers masks with customers\u2019 faces printed on them, so they can unlock their smartphones without having to remove it.<\/p>\n<h2>Growing incentives for wearing masks<\/h2>\n<p>Even <a href=\"https:\/\/qz.com\/299003\/a-quick-history-of-why-asians-wear-surgical-masks-in-public\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">before the coronavirus pandemic<\/a>, masks were a common defense against air pollution and viral infection in countries including China and Japan.<\/p>\n<p>Political <a href=\"https:\/\/www.bbc.com\/news\/world-asia-china-49939173\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">activists<\/a> also wear masks to evade detection on the streets. Both the <a href=\"https:\/\/www.nytimes.com\/2019\/07\/26\/technology\/hong-kong-protests-facial-recognition-surveillance.html\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Hong Kong<\/a> and <a href=\"https:\/\/www.washingtonpost.com\/technology\/2020\/06\/12\/facial-recognition-ban\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Black Lives Matter<\/a> protests have reinforced protesters\u2019 desire to dodge facial recognition by <a href=\"https:\/\/www.theverge.com\/2020\/7\/17\/21328287\/face-masks-facial-recognition-privacy-security-protests\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">authorities and government agencies<\/a>.<\/p>\n<p>As experts forecast a future with more <a href=\"https:\/\/theconversation.com\/this-isnt-the-first-global-pandemic-and-it-wont-be-the-last-heres-what-weve-learned-from-4-others-throughout-history-136231\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">pandemics<\/a>, <a href=\"https:\/\/www.theguardian.com\/environment\/2016\/may\/12\/air-pollution-rising-at-an-alarming-rate-in-worlds-cities\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">rising levels<\/a> of <a href=\"https:\/\/www.who.int\/health-topics\/air-pollution#tab=tab_1\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">air pollution<\/a>, persisting <a href=\"https:\/\/freedomhouse.org\/report\/freedom-world\/2020\/leaderless-struggle-democracy\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">authoritarian regimes<\/a> and a projected <a href=\"https:\/\/theconversation.com\/how-climate-change-is-increasing-the-risk-of-wildfires-99056\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">increase<\/a> in <a href=\"https:\/\/theconversation.com\/climate-change-is-bringing-a-new-world-of-bushfires-123261\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">bushfires<\/a> producing dangerous smoke \u2013 it\u2019s likely mask-wearing will become the norm for at least a proportion of us.<\/p>\n<p>Facial recognition systems will need to adapt. Detection will be based on features that remain visible such as the eyes, eyebrows, hairline and general shape of the face.<\/p>\n<p>Such technologies are already under development. Several suppliers are offering <a href=\"https:\/\/www.facewatch.co.uk\/2020\/05\/11\/facewatch-launches-facemask-recognition-upgrade\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">upgrades<\/a> and <a href=\"https:\/\/www.prnewswire.com\/news-releases\/finally-a-biometric-solution-that-recognizes-users-wearing-face-masks-and-doesnt-require-touch-301069400.html\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">solutions<\/a> that claim to deliver reliable results with mask-wearing subjects.<\/p>\n<p>For those who oppose the use of facial recognition and wish to go undetected, a plain mask may suffice for now. But in the future they might have to consider alternatives, such as a mask printed with a fake <a href=\"https:\/\/thispersondoesnotexist.com\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">computer-generated face<\/a>.<!-- Below is The Conversation's page counter tag. Please DO NOT REMOVE. --><img decoding=\"async\" loading=\"lazy\" src=\"https:\/\/counter.theconversation.com\/content\/144417\/count.gif?distributor=republish-lightbox-basic\" alt=\"The Conversation\" width=\"1\" height=\"1\" class=\" lazy\" data-lazy=\"true\"><!-- End of code. If you don't see any code above, please get new code from the Advanced tab after you click the republish button. The page counter does not collect any personal data. More info: https:\/\/theconversation.com\/republishing-guidelines --><\/p>\n<hr>\n<p><em>This article is republished from <a href=\"https:\/\/theconversation.com\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">The Conversation<\/a>&nbsp;by&nbsp;<a href=\"https:\/\/theconversation.com\/profiles\/paul-haskell-dowland-382903\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Paul Haskell-Dowland<\/a>, Associate Dean (Computing and Security), <a href=\"https:\/\/theconversation.com\/institutions\/edith-cowan-university-720\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Edith Cowan University<\/a>&nbsp;under a Creative Commons license. Read the <a href=\"https:\/\/theconversation.com\/face-masks-and-facial-recognition-will-both-be-common-in-the-future-how-will-they-co-exist-144417\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">original article<\/a>.<\/em><\/p>\n<p class=\"c-post-pubDate\"> Published October 11, 2020 \u2014 17:00 UTC <\/p>\n<p> <a href=\"https:\/\/thenextweb.com\/neural\/2020\/10\/11\/how-facial-recognition-systems-are-adapting-to-masks-syndication\/\">Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>It\u2019s surprising how quickly public opinion can change. Winding the clocks back 12 months, many of us would have looked at a masked individual in public with suspicion. Now, some countries have&#8230;<\/p>\n","protected":false},"author":1,"featured_media":254,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/253"}],"collection":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=253"}],"version-history":[{"count":0,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/253\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/media\/254"}],"wp:attachment":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=253"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=253"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=253"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}