{"id":339,"date":"2020-10-14T10:19:41","date_gmt":"2020-10-14T10:19:41","guid":{"rendered":"https:\/\/thenextweb.com\/?p=1323292"},"modified":"2020-10-14T10:19:41","modified_gmt":"2020-10-14T10:19:41","slug":"remote-exam-software-is-crashing-when-the-stakes-are-the-highest","status":"publish","type":"post","link":"https:\/\/www.londonchiropracter.com\/?p=339","title":{"rendered":"Remote exam software is crashing when the stakes are the highest"},"content":{"rendered":"\n<p>Molly Savage never expected she\u2019d be taking the Michigan state bar exam remotely after graduating this year from Wayne State University\u2019s law school. Nevertheless, in July, she found herself sitting down in an office at the law firm where she already worked, taking the final seven-hour test that stood between her and a license to practice law.<\/p>\n<p>Michigan, like many states around the country, had chosen a software company\u2014in this case, ExamSoft\u2014to administer the test and \u201cproctor\u201d it remotely. Savage had had a bit of trouble tracking down a computer that could run the software, which films test-takers through their computer\u2019s camera, and the whole thing felt a bit creepy.<\/p>\n<p>\u201cWho\u2019s actually reviewing this?\u201d she wondered. \u201cIs it a human being who\u2019s reviewing it in real time?\u201d<\/p>\n<p>And then something even stranger happened: Midway through the test, a website meant to deliver passwords used to access the exam failed.<\/p>\n<p>For Savage, the already high-stakes, high-stress test became \u201ckind of chaos,\u201d she said.<\/p>\n<p>The log-in process, the <a href=\"https:\/\/twitter.com\/examsoft\/status\/1288241360039010307\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">company later said<\/a>, had been targeted in a \u201csophisticated\u201d cyberattack. Panicked test-takers around the state were calling ExamSoft, unable to pass the log-in page as the time ticked down on their exams. The company was able to get the test back on track, and according to a statement, \u201cat no time was any data compromised.\u201d<\/p>\n<p>Nici Sandberg, a spokesperson for ExamSoft, said the company has since taken steps to improve its defenses against future attacks. But it\u2019s not the first time ExamSoft\u2019s digital proctoring has run into problems.<\/p>\n<h2>\u201cBarmageddon\u201d<\/h2>\n<p>In 2015, <a href=\"https:\/\/www.abajournal.com\/news\/article\/examsoft_settles_barmageddon_suit_did_problems_lead_to_lower_exam_scores\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">the company agreed to pay<\/a> more than $2 million to settle a class action suit after software failures affected the bar exams in 43 states. At the time, the situation spawned a catchy epithet: \u201cbarmageddon.\u201d The company declined to comment on those incidents.<\/p>\n<p>And this year, two states with contracts with the proctoring company ILG Technologies, Indiana and Nevada, <a href=\"https:\/\/www.law.com\/2020\/07\/27\/indiana-and-nevada-postpone-bar-exams-raising-questions-about-feasibility-of-online-tests\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">postponed their remote bar exams<\/a> after technical glitches were revealed during practice testing. ILG Technologies did not respond to a request for comment. Officials offering the exams in Michigan, Indiana, and Nevada also did not reply to requests for comment.<\/p>\n<p>But that hasn\u2019t stopped more and more state bar associations, along with a growing number of universities, from turning to companies that produce remote proctoring software\u2014the <a href=\"https:\/\/www.vox.com\/recode\/2020\/5\/4\/21241062\/schools-cheating-proctorio-artificial-intelligence\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">University of Washington<\/a>, <a href=\"https:\/\/www.columbiatribune.com\/story\/news\/education\/2020\/06\/26\/university-of-missouri-student-raises-concerns-about-privacy-in-online-tests\/42456685\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">University of Missouri<\/a>, and the University of California system are just a few of the many schools that have turned to the tools.<\/p>\n<p>One executive from a company called Examity <a href=\"https:\/\/www.insidehighered.com\/news\/2020\/05\/11\/online-proctoring-surging-during-covid-19\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">recently told Inside Higher Ed<\/a> that the company\u2019s growth was up 35 percent over what was expected in its quarterly forecast. Another, from a company called Proctorio, <a href=\"https:\/\/www.washingtonpost.com\/technology\/2020\/04\/01\/online-proctoring-college-exams-coronavirus\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">told The Washington Post<\/a> his company would \u201cprobably increase our value by four to five X just this year.\u201d<\/p>\n<p>Even before the pandemic, the tools were being widely adopted. In 2018, Examity <a href=\"https:\/\/www.prnewswire.com\/news-releases\/global-demand-for-online-test-integrity-fuels-rapid-growth-of-digital-proctoring-platform-300590065.html\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">reported that it had seen five straight years<\/a> of more than 50 percent growth. That growth is likely to continue unabated as schools remain remote.<\/p>\n<p>The states The Markup contacted did not respond to requests for the dollar amounts of contracts with exam companies, but ExamSoft, for example, has been known to charge each exam-taker <a href=\"https:\/\/examsoft.com\/chp\/dynamic\/customcenter.asp?sid=469&amp;c=1&amp;cf=wabar&amp;cn=Washington%20State%20Bar%20Association&amp;et=student.asp#:~:text=The%20Examsoft%20license%20fee%20is,through%20your%20online%20applicant%20homepage.\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">$134.50 in licensing fees<\/a> as part of its contract. Normally, thousands of people take the bar around the country each year.<\/p>\n<h2>Tracking eyes and faces<\/h2>\n<p>Meanwhile, privacy advocates say the technology, which purports to track eyes, scan faces, and monitor typing, is troubling.<\/p>\n<p>\u201cA bar exam that forces our future colleagues to use invasive and unproven technology \u2026 and potentially endure discrimination is antithetical to everything the law is meant to uphold,\u201d Albert Fox Cahn, executive director of the Surveillance Technology Oversight Project, wrote this month in<a href=\"https:\/\/static1.squarespace.com\/static\/5c1bfc7eee175995a4ceb638\/t\/5f514bbf131f3a734a71cc04\/1599163327201\/2020-9-3_NY+Diploma+Privilege+Letter_FINAL+PDF.pdf\" target=\"_blank\" rel=\"nofollow noopener noreferrer\"> a letter to New York officials<\/a> asking them to reconsider the use of ExamSoft for the state\u2019s bar exam, citing concerns of the potential for racial bias in tools like face-scanning. (Some test-takers have recently said they faced<a href=\"https:\/\/www.nytimes.com\/2020\/09\/29\/style\/testing-schools-proctorio.html\" target=\"_blank\" rel=\"nofollow noopener noreferrer\"> exactly that problem<\/a> with the software\u2014that it appeared to struggle to recognize darker features.)<\/p>\n<p>ExamSoft\u2019s Sandberg said, \u201c[A]ll exams are first reviewed by AI, flagged for potential incidents and then also re-reviewed by professional human proctors.\u201d<\/p>\n<p>The Electronic Frontier Foundation <a href=\"https:\/\/www.eff.org\/deeplinks\/2020\/09\/eff-tells-california-supreme-court-not-require-examsoft-bar-exam\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">raised similar concerns<\/a> about the California state bar exam. Both that exam and the New York exam were given remotely through ExamSoft last week.<\/p>\n<h2>Open Book Tests or No Tests at All?<\/h2>\n<p>The question is, in a pandemic\u2019s world, what the alternatives really are.<\/p>\n<p>One option, \u201cdiploma privilege,\u201d is used in Wisconsin. It\u2019s a process that allows some in-state law graduates to become licensed to practice without taking the bar exam. A few other states have given <a href=\"https:\/\/www.abajournal.com\/news\/article\/third-state-agrees-to-temporary-diploma-privilege-with-some-restrictions\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">2020 law school graduates<\/a> who complete certain requirements such privileges, laying a path to practice as lawyers without taking the exam.<\/p>\n<p>But other states have been more reluctant. In Florida, a group of law graduates filed a petition in the state\u2019s Supreme Court court <a href=\"https:\/\/www.law360.com\/articles\/1299950\/fla-bar-exam-software-sows-chaos-for-grads\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">against<\/a> the use of ILG software for the state\u2019s exam this year. The graduates asked to have the exam waived for the year and to be allowed to practice after working with a licensed attorney for six months. The court <a href=\"https:\/\/www.tampabay.com\/florida-politics\/buzz\/2020\/09\/03\/waiving-bar-exams-a-no-go-says-florida-supreme-court\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">ultimately shot down<\/a> the request. The Florida Board of Bar Examiners did not respond to a request for comment.<\/p>\n<p>At the University of California, Santa Barbara, faculty sent <a href=\"https:\/\/cucfa.org\/wp-content\/uploads\/2020\/03\/ProctorU_2020-1.pdf\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">a letter<\/a> to the administration objecting to the broad categories of data, from identifying physical details to keystrokes, used by ProctorU, another provider of software used for remote exams. \u201cWe recognize that in our collective race to adapt our coursework and delivery in good faith, there are trade-offs and unfortunate aspects of the migration online that we must accept,\u201d the faculty wrote. \u201cThis is not one of them.\u201d (The company <a href=\"https:\/\/www.techdirt.com\/articles\/20200326\/10164144178\/can-proctoru-be-trusted-with-students-personal-data.shtml\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">threatened legal action<\/a> against the faculty over the letter and said it only collects data for proctoring purposes. Use of the software is currently optional.)<\/p>\n<p>\u201cOn campus, we are there to protect our students; we feel responsible for our students,\u201d Jennifer Holt, a film and media studies professor at UC Santa Barbara and part of the faculty association, told The Markup. \u201cThat,\u201d she said, \u201cdoesn\u2019t change because instruction has moved online.\u201d The use of the software isn\u2019t required, but there\u2019s little alternative beyond changing the format of tests.<\/p>\n<p>Some experts in education question whether the problems go beyond the use of any specific software.<\/p>\n<p>\u201cThis is a case where we\u2019re trying to use the technology Band-Aid for a problem that\u2019s much more fundamental,\u201d said David Rettinger, a professor of psychological science at the University of Mary Washington, who studies ethics in education.<\/p>\n<p>Rettinger said educators should consider relying more on different forms of testing, like open-book exams, which may better demonstrate how much students have learned. That could also create a less adversarial learning environment, he said, one that\u2019s built more soundly on trust. It\u2019s not exactly a silver lining, he said, since these are problems that suddenly have to be solved immediately, instead of over time.<\/p>\n<p>Holt, for one, said she\u2019d given the first open-book exam of her career recently. \u201cThese are crazy times,\u201d she said. \u201cWe\u2019ve got to make adjustments.\u201d<\/p>\n<p>But, she added, \u201cwe have to do it in a way that has these students in mind first.\u201d<\/p>\n<hr>\n<p><a href=\"https:\/\/themarkup.org\/coronavirus\/2020\/10\/13\/remote-exam-software-failures-privacy\" target=\"_blank\" rel=\"nofollow noopener noreferrer\"><img decoding=\"async\" src=\"https:\/\/mrkp-static-production.themarkup.org\/static\/img\/republish-logo.png\" alt=\"Originally published on themarkup.org\" class=\" lazy\" data-lazy=\"true\"><\/a><\/p>\n<p><em>This article was <a href=\"https:\/\/themarkup.org\/coronavirus\/2020\/10\/13\/remote-exam-software-failures-privacy\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">originally published on The Markup<\/a>&nbsp;by Colin Lecher and was republished under the <a href=\"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Creative Commons Attribution-NonCommercial-NoDerivatives<\/a><a rel=\"nofollow noopener\"> license.<\/a><\/em><\/p>\n<p> <a href=\"https:\/\/thenextweb.com\/syndication\/2020\/10\/14\/remote-exam-software-is-crashing-when-the-stakes-are-the-highest\/\">Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Molly Savage never expected she\u2019d be taking the Michigan state bar exam remotely after graduating this year from Wayne State University\u2019s law school. Nevertheless, in July, she found herself sitting down in&#8230;<\/p>\n","protected":false},"author":1,"featured_media":340,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/339"}],"collection":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=339"}],"version-history":[{"count":0,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/339\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/media\/340"}],"wp:attachment":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=339"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=339"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=339"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}