{"id":2867,"date":"2021-02-05T17:37:23","date_gmt":"2021-02-05T17:37:23","guid":{"rendered":"https:\/\/thenextweb.com\/?p=1337830"},"modified":"2021-02-05T17:37:23","modified_gmt":"2021-02-05T17:37:23","slug":"this-ai-generates-music-from-silent-piano-performances","status":"publish","type":"post","link":"https:\/\/www.londonchiropracter.com\/?p=2867","title":{"rendered":"This AI generates music from silent piano performances"},"content":{"rendered":"\n
<\/div>\n

Scientists have developed an AI that can generate music from silent piano performances, just by watching the movements of the player\u2019s hands.<\/p>\n

The system, called Audeo, analyzes top-down videos of someone tickling the ivories to predict which keys are being pressed in each frame. It then produces a transcript of the music, which a synthesizer translates into sound.<\/p>\n

The researchers trained and tested the AI on footage of<\/span> <\/span>pianist Paul Barton<\/a> playing tunes by famous composers.<\/p>\n

They then evaluated the accuracy of the Audeo\u2019s compositions by playing them to music-recognition apps, such as Shazam and SoundHound.<\/p>\n

The apps identified the tune 86% of the time  \u2014 just 7% less than they recognized the source videos.<\/p>\n

[Read: How much does it cost to buy, own, and run an EV? It\u2019s not as much as you think<\/a>]<\/em><\/p>\n

Senior study author Eli Shlizerman, an assistant professor at the University of Washington, said<\/a> he was surprised by the quality of the AI\u2019s output:<\/p>\n

\n

To create music that sounds like it could be played in a musical performance was previously believed to be impossible. An algorithm needs to figure out the cues, or \u2018features\u2019 in the video frames that are related to generating music, and it needs to \u2018imagine\u2019 the sound that\u2019s happening in between the video frames. It requires a system that is both precise and imaginative. <\/span><\/p>\n<\/blockquote>\n

You can judge its performances for yourself in the video below:<\/p>\n

The researchers have also explored using Audeo to change the style of music. Shlizerman said the system could show how music produced by a piano sounds when played through a trumpet.<\/p>\n

He hopes the research will enable new ways for people to interact with music:<\/p>\n

\n

For example, one future application is that Audeo can be extended to a virtual piano with a camera recording just a person\u2019s hands. Also, by placing a camera on top of a real piano, Audeo could potentially assist in new ways of teaching students how to play.<\/span><\/p>\n<\/blockquote>\n

You can read the full study paper here<\/a>.<\/p>\n

Published February 5, 2021 \u2014 17:37 UTC <\/p>\n

Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Scientists have developed an AI that can generate music from silent piano performances, just by watching the movements of the player\u2019s hands. The system, called Audeo, analyzes top-down videos of someone tickling the…<\/p>\n","protected":false},"author":1,"featured_media":2868,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/2867"}],"collection":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=2867"}],"version-history":[{"count":0,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/2867\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/media\/2868"}],"wp:attachment":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=2867"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=2867"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=2867"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}