{"id":8801,"date":"2021-11-06T07:00:39","date_gmt":"2021-11-06T07:00:39","guid":{"rendered":"http:\/\/TheNextWeb=1372249"},"modified":"2021-11-06T07:00:39","modified_gmt":"2021-11-06T07:00:39","slug":"dont-believe-the-headlines-ai-isnt-uncovering-any-art-mysteries","status":"publish","type":"post","link":"https:\/\/www.londonchiropracter.com\/?p=8801","title":{"rendered":"Don\u2019t believe the headlines: AI isn\u2019t uncovering any art mysteries"},"content":{"rendered":"\n<p>People tend to rejoice in the disclosure of a secret.<\/p>\n<p>Or, at the very least, media outlets have come to realize that news of \u201cmysteries solved\u201d and \u201chidden treasures revealed\u201d generate traffic and clicks.<\/p>\n<p>So I\u2019m never surprised when I see AI-assisted revelations about famous masters\u2019 works of art go viral.<\/p>\n<p>Over the past year alone, I\u2019ve come across articles highlighting how artificial intelligence <a href=\"https:\/\/www.theguardian.com\/artanddesign\/2021\/jun\/06\/modigliani-lost-lover-beatrice-hastings\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">recovered a \u201csecret\u201d painting<\/a> of a \u201clost lover\u201d of Italian painter Modigliani, <a href=\"https:\/\/www.cnn.com\/style\/article\/hidden-picasso-nude-scli-intl-gbr\/index.html\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">\u201cbrought to life\u201d a \u201chidden Picasso nude\u201d<\/a>, <a href=\"https:\/\/www.smithsonianmag.com\/smart-news\/klimt-painting-restore-artificial-intelligence-color-faculty-paintings-180978843\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">\u201cresurrected\u201d Austrian painter Gustav Klimt\u2019s destroyed works<\/a> and <a href=\"https:\/\/www.bbc.com\/news\/technology-57588270\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">\u201crestored\u201d portions of Rembrandt\u2019s 1642 painting \u201cThe Night Watch.\u201d<\/a><a href=\"https:\/\/www.sciencedaily.com\/releases\/2019\/08\/190830150738.htm\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">The list goes on<\/a>.<\/p>\n<p><a href=\"https:\/\/www.umass.edu\/arthistory\/member\/sonja-drimmer\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">As an art historian<\/a>, I\u2019ve become increasingly concerned about the coverage and circulation of these projects.<\/p>\n<p>They have not, in actuality, revealed one secret or solved a single mystery.<\/p>\n<p>What they have done is generate feel-good stories about AI.<\/p>\n<h2>Are we actually learning anything new?<\/h2>\n<p>Take the reports about the Modigliani and Picasso paintings.<\/p>\n<p>These were projects executed by the same company, <a href=\"https:\/\/www.oxia-palus.com\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Oxia Palus<\/a>, which was founded not by art historians but by doctoral students in machine learning.<\/p>\n<p>In both cases, Oxia Palus relied upon traditional X-rays, X-ray fluorescence and infrared imaging that had already been <a href=\"https:\/\/www.metmuseum.org\/art\/metpublications\/Picasso_in_The_Metropolitan_Museum_of_Art\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">carried out and published<\/a><a href=\"https:\/\/www.theguardian.com\/artanddesign\/2018\/feb\/28\/modigliani-portrait-comes-to-light-beneath-artists-later-picture\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">years prior<\/a> \u2013 work that had revealed preliminary paintings beneath the visible layer on the artists\u2019 canvases.<\/p>\n<p>The company edited these X-rays and <a href=\"https:\/\/arxiv.org\/abs\/1909.05677\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">reconstituted them as new works of art<\/a> by applying a technique called \u201c<a href=\"https:\/\/arxiv.org\/pdf\/1508.06576.pdf\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">neural style transfer<\/a>.\u201d This is a sophisticated-sounding term for a program that breaks works of art down into extremely small units, extrapolates a style from them, and then promises to recreate images of other content in that same style.<\/p>\n<p>Essentially, Oxia Palus stitches new works out of what the machine can learn from the existing X-ray images and other paintings by the same artist.<\/p>\n<p>But outside of flexing the prowess of AI, is there any value \u2013 artistically, historically \u2013 to what the company is doing?<\/p>\n<p>These recreations don\u2019t teach us anything we didn\u2019t know about the artists and their methods.<\/p>\n<p>Artists paint over their works all the time. It\u2019s so common that art historians and conservators have a word for it: <a href=\"https:\/\/www.nationalgallery.org.uk\/paintings\/glossary\/pentimento\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">pentimento<\/a>. None of these earlier compositions was an Easter egg deposited in the painting for later researchers to discover. The original X-ray images were certainly valuable in that they <a href=\"https:\/\/www.academia.edu\/40255609\/The_Getty_Conservation_Institute_From_Connoisseurship_to_Technical_Art_History_The_Evolution_of_the_Interdisciplinary_Study_of_Art\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">offered insights into artists\u2019 working methods<\/a>.<\/p>\n<p>But to me, what these programs are doing isn\u2019t exactly newsworthy from the perspective of art history.<\/p>\n<h2>The humanities on life support<\/h2>\n<p>So when I do see these reproductions attracting media attention, it strikes me as soft diplomacy for AI, showcasing a \u201ccultured\u201d application of the technology at a time when skepticism of its <a href=\"https:\/\/www.theguardian.com\/technology\/2020\/jan\/13\/what-are-deepfakes-and-how-can-you-spot-them\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">deceptions<\/a>, <a href=\"https:\/\/nyupress.org\/9781479837243\/algorithms-of-oppression\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">biases<\/a>, and <a href=\"https:\/\/www.wiley.com\/en-us\/Race+After+Technology:+Abolitionist+Tools+for+the+New+Jim+Code-p-9781509526437\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">abuses<\/a> is on the rise.<\/p>\n<p>When AI gets attention for recovering lost works of art, it makes the technology sound a lot less scary than when it garners headlines <a href=\"https:\/\/www.cbsnews.com\/news\/deepfake-artificial-intelligence-60-minutes-2021-10-10\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">for creating deep fakes that falsify politicians\u2019 speech<\/a> or <a href=\"https:\/\/www.politico.eu\/article\/the-rise-of-ai-surveillance-coronavirus-data-collection-tracking-facial-recognition-monitoring\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">for using facial recognition for authoritarian surveillance<\/a>.<\/p>\n<p>These studies and projects also seem to promote the idea that computer scientists are more adept at historical research than art historians.<\/p>\n<p>For years, university humanities departments <a href=\"https:\/\/carrollnews.org\/3680\/campus\/art-history-department-to-be-eliminated-tenured-faculty-receive-termination-notices\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">have been gradually squeezed of funding<\/a>, with more money funneled into the sciences. With their claims to objectivity and empirically provable results, the sciences tend to command greater respect from funding bodies and the public, which offers an incentive to scholars in the humanities to adopt computational methods.<\/p>\n<p>Art historian Claire Bishop <a href=\"https:\/\/journals.ub.uni-heidelberg.de\/index.php\/dah\/article\/view\/49915\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">criticized this development<\/a>, noting that when computer science becomes integrated into the humanities, \u201c[t]heoretical problems are steamrollered flat by the weight of data,\u201d which generates deeply simplistic results.<\/p>\n<p>At their core, art historians study the ways in which art can offer insights into how people once saw the world. They explore how works of art shaped the worlds in which they were made and would go on to influence future generations.<\/p>\n<p>A computer algorithm cannot perform these functions.<\/p>\n<p>However, some scholars and institutions have allowed themselves to be subsumed by the sciences, adopting their methods and partnering with them in sponsored projects.<\/p>\n<p>Literary critic Barbara Herrnstein Smith <a href=\"https:\/\/www.jstor.org\/stable\/10.3366\/j.ctt1r2bq2.9?seq=1#metadata_info_tab_contents\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">has warned about ceding too much ground to the sciences<\/a>. In her view, the sciences and the humanities are not the polar opposites they are often publicly portrayed to be. But this portrayal has been to the benefit of the sciences, prized for their supposed clarity and utility over the humanities\u2019 alleged obscurity and uselessness. At the same time, she <a href=\"https:\/\/doi.org\/10.1215\/0961754X-3622212\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">has suggested<\/a> that hybrid fields of study that fuse the arts with the sciences may lead to breakthroughs that wouldn\u2019t have been possible had each existed as a siloed discipline.<\/p>\n<p>I\u2019m skeptical. Not because I doubt the utility of expanding and diversifying our toolbox; to be sure, some <a href=\"http:\/\/www.mappingsenufo.org\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">scholars working in the digital humanities<\/a> have taken up computational methods with subtlety and historical awareness to add nuance to or overturn entrenched narratives.<\/p>\n<p>But my lingering suspicion emerges from an awareness of how public support for the sciences and disparagement of the humanities means that, in the endeavor to gain funding and acceptance, the humanities will lose what makes them vital. The field\u2019s sensitivity to historical particularity and cultural difference makes the application of the same code to widely diverse artifacts utterly illogical.<\/p>\n<p>How absurd to think that black-and-white photographs from 100 years ago would produce colors in the same way that digital photographs do now. And yet, this is exactly what <a href=\"https:\/\/hyperallergic.com\/639395\/the-limits-of-colorization-of-historical-images-by-ai\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">AI-assisted colorization<\/a> does.<\/p>\n<p>That particular example might sound like a small qualm, sure. But this effort to \u201c<a href=\"https:\/\/deepai.org\/machine-learning-model\/colorizer\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">bring events back to life<\/a>\u201d routinely mistakes representations for reality. Adding color does not show things as they were but recreates what is already a recreation \u2013 a photograph \u2013 in our own image, now with computer science\u2019s seal of approval.<\/p>\n<h2>Art as a toy in the sandbox of scientists<\/h2>\n<p>Near the conclusion of <a href=\"https:\/\/doi.org\/10.1126\/sciadv.aaw7416\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">a recent paper<\/a> devoted to the use of AI to disentangle X-ray images of Jan and Hubert van Eyck\u2019s \u201c<a href=\"https:\/\/www.getty.edu\/foundation\/initiatives\/past\/panelpaintings\/panel_paintings_ghent.html\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Ghent Altarpiece<\/a>,\u201d the mathematicians and engineers who authored it refer to their method as relying upon \u201cchoosing \u2018the best of all possible worlds\u2019 (borrowing Voltaire\u2019s words) by taking the first output of two separate runs, differing only in the ordering of the inputs.\u201d<\/p>\n<p>Perhaps if they had familiarized themselves with the humanities more they would know how satirically those words were meant when Voltaire <a href=\"https:\/\/brill.com\/view\/title\/20877\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">used them to mock a philosopher<\/a> who believed that rampant suffering and injustice were all part of God\u2019s plan \u2013 that the world as it was represented the best we could hope for.<\/p>\n<p>Maybe this \u201cgotcha\u201d is cheap. But it illustrates the problem of art and history becoming toys in the sandboxes of scientists with no training in the humanities.<\/p>\n<p>If nothing else, my hope is that journalists and critics who report on these developments will cast a more skeptical eye on them and alter their framing.<\/p>\n<p>In my view, rather than lionizing these studies as heroic achievements, those responsible for conveying their results to the public should see them as opportunities to question what the computational sciences are doing when they appropriate the study of art. And they should ask whether any of this is for the good of anyone or anything but AI, its most zealous proponents and those who profit from it.<!-- Below is The Conversation's page counter tag. Please DO NOT REMOVE. --><img decoding=\"async\" loading=\"lazy\" src=\"https:\/\/counter.theconversation.com\/content\/170691\/count.gif?distributor=republish-lightbox-basic\" alt=\"The Conversation\" width=\"1\" height=\"1\" class=\"js-lazy\"><!-- End of code. If you don't see any code above, please get new code from the Advanced tab after you click the republish button. The page counter does not collect any personal data. More info: https:\/\/theconversation.com\/republishing-guidelines --><\/p>\n<p><noscript><img decoding=\"async\" loading=\"lazy\" src=\"https:\/\/counter.theconversation.com\/content\/170691\/count.gif?distributor=republish-lightbox-basic\" alt=\"The Conversation\" width=\"1\" height=\"1\" class><\/noscript><\/p>\n<p>This article by <span><a href=\"https:\/\/theconversation.com\/profiles\/sonja-drimmer-1161741\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Sonja Drimmer<\/a>, Associate Professor of Medieval Art, <em><a href=\"https:\/\/theconversation.com\/institutions\/university-of-massachusetts-amherst-1563\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">University of Massachusetts Amherst<\/a><\/em><\/span> is republished from <em><a href=\"https:\/\/theconversation.com\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">The Conversation<\/a> under a Creative Commons license. Read the <a href=\"https:\/\/theconversation.com\/how-ai-is-hijacking-art-history-170691\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">original article<\/a>.<\/em><\/p>\n<p> <a href=\"https:\/\/thenextweb.com\/news\/dont-believe-the-headlines-ai-isnt-uncovering-art-mysteries\">Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>People tend to rejoice in the disclosure of a secret. Or, at the very least, media outlets have come to realize that news of \u201cmysteries solved\u201d and \u201chidden treasures revealed\u201d generate traffic&#8230;<\/p>\n","protected":false},"author":1,"featured_media":8802,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/8801"}],"collection":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=8801"}],"version-history":[{"count":0,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/8801\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/media\/8802"}],"wp:attachment":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=8801"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=8801"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=8801"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}