{"id":9077,"date":"2021-11-22T19:23:21","date_gmt":"2021-11-22T19:23:21","guid":{"rendered":"http:\/\/TheNextWeb=1373841"},"modified":"2021-11-22T19:23:21","modified_gmt":"2021-11-22T19:23:21","slug":"nyc-bill-to-rein-in-ai-hiring-tools-looks-like-it-was-meant-to-backfire","status":"publish","type":"post","link":"https:\/\/www.londonchiropracter.com\/?p=9077","title":{"rendered":"NYC bill to rein in AI hiring tools looks like it was meant to backfire"},"content":{"rendered":"\n<div><img decoding=\"async\" src=\"https:\/\/img-cdn.tnwcdn.com\/image\/neural?filter_last=1&amp;fit=1280%2C640&amp;url=https%3A%2F%2Fcdn0.tnwcdn.com%2Fwp-content%2Fblogs.dir%2F1%2Ffiles%2F2021%2F07%2Frobots-work.jpg&amp;signature=ea7f72b96f4da757f5cf14c1969e9bad\" class=\"ff-og-image-inserted\"><\/div>\n<p>New York recently passed a bill providing guidelines for the operation of automated hiring software in the city. Allegedly, city council\u2019s aim with this legislation was to protect New Yorkers from biased AI. But, from where we\u2019re sitting, it looks like it\u2019s going to do the exact opposite.<\/p>\n<p><strong>Up front:<\/strong> The bill, dubbed <a href=\"https:\/\/legistar.council.nyc.gov\/LegislationDetail.aspx?ID=4344524&amp;GUID=B051915D-A9AC-451E-81F8-6596032FA3F9\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">int 1894-2020<\/a>, was meant to address the issue of bias in AI software.<\/p>\n<p>Companies such as HireVue claim their algorithms can actually remove hiring bias \u2013 the schtick here is that <em>computers can\u2019t be bigots<\/em>.<\/p>\n<p>But the reality is that there\u2019s no magic way to remove bias from an AI system. Algorithms aren\u2019t magical spells. They\u2019re usually math-based guidelines. And, because computers and algorithms are designed and programmed by humans, they contain <a href=\"https:\/\/perception.org\/research\/implicit-bias\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">inherent bias<\/a>.<\/p>\n<p><strong>In other words:<\/strong> A computer cannot make value judgements on human beings. All they can do is make \u201cguesses.\u201d Some guesses are harmless, like when Netflix guesses you\u2019ll like a certain movie and you don\u2019t. You can just watch something else. Other guesses are bad, like when an algorithm decides you\u2019re not worth hiring.<\/p>\n<p><a href=\"https:\/\/thenextweb.com\/news\/ai-cant-tell-youre-lying-anyone-who-says-otherwise-selling-something\">AI absolutely cannot tell if you\u2019re lying<\/a>. AI <a href=\"https:\/\/www.technologyreview.com\/2020\/02\/14\/844765\/ai-emotion-recognition-affective-computing-hirevue-regulation-ethics\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">can\u2019t understand emotions<\/a>. And it certainly <a href=\"https:\/\/towardsdatascience.com\/why-ai-is-so-smart-and-yet-so-dumb-c156cc87fafa\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">can\u2019t measure human intelligence<\/a>. Which makes most of the claims made by companies specializing in automated hiring systems specious at best and outright lies at worst.<\/p>\n<p>But the real question here isn\u2019t whether an AI can predict whether a human will be a good fit for a given job (<a href=\"https:\/\/thenextweb.com\/news\/why-using-ai-to-screen-job-applicants-is-almost-always-a-bunch-of-crap\">it definitely can\u2019t<\/a>), it\u2019s whether or not the new bill can protect New Yorkers from predatory snake oil companies that claim it can.<\/p>\n<p><strong>Good idea:<\/strong> passing a bill that protects New Yorkers from predatory snake oil companies.<\/p>\n<p>It\u2019s long past time politicians in the US to did something about <a href=\"https:\/\/jolt.law.harvard.edu\/assets\/articlePDFs\/v31\/The-Artificial-Intelligence-Black-Box-and-the-Failure-of-Intent-and-Causation-Yavar-Bathaee.pdf\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">these demonstrably harmful AI systems<\/a> and the companies peddling them.<\/p>\n<p><strong>Bad idea:<\/strong> letting the software\u2019s <em>vendors<\/em> decide whether an algorithm is biased or not.<\/p>\n<p>Per the bill:<\/p>\n<blockquote readability=\"10\">\n<p>This bill would require that a bias audit be conducted on an automated employment decision tool prior to the use of said tool. The bill would also require that candidates or employees that reside in the city be notified about the use of such tools in the assessment or evaluation for hire or promotion, as well as, be notified about the job qualifications and characteristics that will be used by the automated employment decision tool. Violations of the provisions of the bill would be subject to a civil penalty.<\/p>\n<\/blockquote>\n<p>But, those violations? They\u2019re feckless. It\u2019s up to the <i>vendor<\/i><span> to conduct and report audits demonstrating their algorithms aren\u2019t biased.&nbsp;<\/span><\/p>\n<p><strong>Quick take:<\/strong> This is like letting <a href=\"https:\/\/marvelcinematicuniverse.fandom.com\/wiki\/Thanos\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Thanos<\/a> conduct audits and report compliance with New York City ethics. \u201cAccording to the big purple dude, his use of the Infinity Gauntlet is perfectly ethical. He did an audit and everything.\u201d<\/p>\n<p>In this case, New York\u2019s passed a bill that gives AI vendors the power to legally determine whether they\u2019re being ethical or not. This doesn\u2019t protect citizens, it protects scammy AI companies.<\/p>\n<p>HireVue gave a statement to the AP that sums it up best. Per <a href=\"https:\/\/apnews.com\/article\/technology-business-race-and-ethnicity-racial-injustice-artificial-intelligence-2fe8d3ef7008d299d9d810f0c0f7905d\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">that article<\/a>:<\/p>\n<blockquote readability=\"9\">\n<p>HireVue, a platform for video-based job interviews, said in a statement this week that it welcomed legislation that \u201cdemands that all vendors meet the high standards that HireVue has supported since the beginning.\u201d<\/p>\n<\/blockquote>\n<p>Exactly. HireVue <a href=\"https:\/\/www.hirevue.com\/press-release\/hirevue-delivers-game-based-assessments-for-measuring-job-related-emotional-intelligence\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">currently uses AI<\/a> to allegedly assess candidates\u2019 \u201ce-motions.\u201d The company actually claims computer vision algorithms can determine a user\u2019s \u201cemotional intelligence.\u201d This, of course, is <a href=\"https:\/\/hbr.org\/2019\/11\/the-risks-of-using-ai-to-interpret-human-emotions\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">not possible<\/a> because <a href=\"https:\/\/www.theatlantic.com\/technology\/archive\/2021\/04\/artificial-intelligence-misreading-human-emotion\/618696\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">AI doesn\u2019t have magic powers<\/a>.<\/p>\n<p>And, if that\u2019s the standard New York\u2019s using to determine whether an AI system is biased, then it\u2019s open season on the Big Apple. I can\u2019t think of a single AI startup, <a href=\"https:\/\/thenextweb.com\/news\/why-are-scummy-scammy-ai-companies-thriving\">no matter how awful and scammy<\/a>, that couldn\u2019t pass that bar.<\/p>\n<p> <a href=\"https:\/\/thenextweb.com\/news\/nyc-bill-rein-in-ai-hiring-tools-looks-like-was-meant-to-backfire\">Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>New York recently passed a bill providing guidelines for the operation of automated hiring software in the city. Allegedly, city council\u2019s aim with this legislation was to protect New Yorkers from biased&#8230;<\/p>\n","protected":false},"author":1,"featured_media":9078,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/9077"}],"collection":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=9077"}],"version-history":[{"count":0,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/9077\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/media\/9078"}],"wp:attachment":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=9077"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=9077"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=9077"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}