{"id":12142,"date":"2022-09-01T22:09:19","date_gmt":"2022-09-01T22:09:19","guid":{"rendered":"http:\/\/TheNextWeb=1391164"},"modified":"2022-09-01T22:09:19","modified_gmt":"2022-09-01T22:09:19","slug":"forget-chess-deepminds-training-its-new-ai-to-play-football","status":"publish","type":"post","link":"https:\/\/www.londonchiropracter.com\/?p=12142","title":{"rendered":"Forget chess, DeepMind\u2019s training its new AI to play football"},"content":{"rendered":"\n<div><img decoding=\"async\" src=\"https:\/\/img-cdn.tnwcdn.com\/image\/tnw?filter_last=1&amp;fit=1280%2C640&amp;url=https%3A%2F%2Fcdn0.tnwcdn.com%2Fwp-content%2Fblogs.dir%2F1%2Ffiles%2F2022%2F09%2Fdeepmindfootball.jpg&amp;signature=c9c7547e41dd0811817adb1b56c4a07d\" class=\"ff-og-image-inserted\"><\/div>\n<p>Researchers from DeepMind, the UK\u2019s juggernaut AI lab, have forsaken the noble games of chess and Go for a more plebeian delight: football.<\/p>\n<p>The Google sister company yesterday published a research paper and accompanying blog post detailing its new neural probabilistic motor primitives (NPMP) \u2014 a method by which <a href=\"https:\/\/thenextweb.com\/topic\/artificial-intelligence\" target=\"_blank\" rel=\"noopener noreferrer\">artificial intelligence<\/a> agents can learn to operate physical bodies.<\/p>\n<p>Per the <a href=\"https:\/\/www.deepmind.com\/blog\/from-motor-control-to-embodied-intelligence\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">blog post<\/a>:<\/p>\n<blockquote readability=\"9\">\n<p>An NPMP is a general-purpose motor control module that translates short-horizon motor intentions to low-level control signals, and it\u2019s trained offline or via RL by imitating motion capture (MoCap) data, recorded with trackers on humans or animals performing motions of interest.<\/p>\n<\/blockquote>\n<div class=\"inarticle-wrapper channel-cta\">\n<div class=\"ica-text\" readability=\"0\"><a href=\"https:\/\/www.thenextweb.com\/conference\/newsletter\" data-event-category=\"Article\" data-event-action=\"In Article Block\" data-event-label=\"Sign up to the TNW Conference newsletter\" target=\"_blank\" readability=\"4\" rel=\"noopener noreferrer\"><\/p>\n<h4>Sign up to the TNW Conference newsletter<\/h4>\n<p>And be the first in line for ticket offers, event news, and more!<\/p>\n<p><\/a><\/div>\n<\/div>\n<p><strong>Up front:<\/strong> Essentially, the DeepMind team created an AI system that can learn how to do things inside of a physics simulator by watching videos of other agents performing those tasks.<\/p>\n<p>And, of course, if you\u2019ve got a giant physics engine and an endless supply of curious robots, the only rational thing to do is to teach it how to dribble and shoot:<\/p>\n<figure>\n<p> <iframe srcdoc=\"\n\n<style>*{padding:0;margin:0;overflow:hidden}html,body{background:#000;height:100%}img{position:absolute;top:0;left:0;width:100%;height:100%;object-fit:cover;transition:opacity .1s cubic-bezier(0.4,0,1,1)}a:hover img+img{opacity:1!important}<\/style>\n<p><a href='https:\/\/www.youtube.com\/embed\/foBwHVenxeU?feature=oembed&amp;autoplay=1&amp;mute=1&amp;modestbranding=1&amp;iv_load_policy=3&amp;theme=light&amp;playsinline=1'><img src='https:\/\/img.youtube.com\/vi\/foBwHVenxeU\/hqdefault.jpg'><img src='https:\/\/cdn0.tnwcdn.com\/wp-content\/themes\/cyberdelia\/assets\/img\/ytplaybtn.png' style='top: 50%;left:50%;width:68px;height:48px;transform:translate3d(-50%,-50%,0)'><img src='https:\/\/cdn0.tnwcdn.com\/wp-content\/themes\/cyberdelia\/assets\/img\/ytplaybtn-hover.png' style='top: 50%;left:50%;width:68px;height:48px;opacity:0;transform:translate3d(-50%,-50%,0)'><\/a>&#8221; height=&#8221;240&#8243; width=&#8221;320&#8243; allow=&#8221;accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture&#8221; allowfullscreen frameborder=&#8221;0&#8243;>[embedded content]<\/iframe> <\/p>\n<\/figure>\n<p> <!--resp-video-container--><\/p>\n<p>According to the team\u2019s <a href=\"https:\/\/www.science.org\/doi\/10.1126\/scirobotics.abo0235\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">research paper<\/a>:<\/p>\n<blockquote readability=\"7\">\n<p>We optimized teams of agents to play simulated football via reinforcement learning, constraining the solution space to that of plausible movements learned using human motion capture data.<\/p>\n<\/blockquote>\n<p><strong>Background:<\/strong> In order to train AI to operate and control robots in the world, researchers have to prepare the machines for reality. And, outside of simulations, anything can happen. Agents have to deal with gravity, unexpectedly slippery surfaces, and unplanned interference from other agents.<\/p>\n<p>The point of the exercise isn\u2019t to build a better footballer \u2014 Cristiano Ronaldo has nothing to fear from the robots, for now \u2014 but instead to help the AI and its developers figure out how to optimize the agents\u2019 ability to predict outcomes.<\/p>\n<p>As the AI starts its training, it\u2019s barely able to move its physics-based humanoid avatar around the field. But, by rewarding an agent every time its team scores a goal, the model is able to get the figures up and running in around 50 hours. After several days of training, the AI begins to predict where the ball will go and how the other agents will react to its movement.<\/p>\n<p>Per the paper:<\/p>\n<blockquote readability=\"10\">\n<p>The result is a team of coordinated humanoid football players that exhibit complex behavior at different scales, quantified by a range of analysis and statistics, including those used in real-world sport analytics. Our work constitutes a complete demonstration of learned integrated decision-making at multiple scales in a multiagent setting.<\/p>\n<\/blockquote>\n<p><strong>Quick take:<\/strong> This work is pretty rad. But we\u2019re not so sure it represents a \u201ccomplete demonstration\u201d of anything. The model is obviously capable of operating an embodied agent. But, based on the <i>apparently cherry-picked<\/i> GIFs on the blog post, this work is still deeply in the simulation phase.<\/p>\n<p>The bottom line here, is that the AI isn\u2019t \u201clearning\u201d how to play football. It\u2019s brute-forcing movement within the boundaries of its simulation. That may seem like a minor quibble, but the results are quite evident:<\/p>\n<p><figure class=\"post-image post-mediaBleed aligncenter\"><video class=\"gifsnomore size-full wp-image-1391193 aligncenter \" autoplay loop muted><source type=\"video\/mp4\" src=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/09\/terrified-robots.mp4\"><\/video><figcaption>Credit: DeepMind<\/figcaption><\/figure>\n<\/p>\n<p>The above AI agent looks absolutely terrified. I don\u2019t know what it\u2019s running away from, but I\u2019m certain that it\u2019s the scariest thing ever.<\/p>\n<p>It moves like an alien wearing a human suit for the first time because, unlike humans, AI cannot learn by watching. Systems like the one DeepMind trained parse thousands of hours of video and, essentially, extricate motion data about the subject their trying to \u201clearn\u201d from.<\/p>\n<p>However, it\u2019s almost certain that these models will become more robust as time goes on. We\u2019ve seen what Boston Dynamics can do with machine learning algorithms and pre-programmed choreography.<\/p>\n<p>It\u2019ll be interesting to see how more adaptive models, such as the ones being developed by DeepMind, will fare once they move beyond the laboratory environment and into actual robotics applications.<\/p>\n<p> <a href=\"https:\/\/thenextweb.com\/news\/forget-chess-deepminds-training-new-ai-play-football\">Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Researchers from DeepMind, the UK\u2019s juggernaut AI lab, have forsaken the noble games of chess and Go for a more plebeian delight: football. The Google sister company yesterday published a research paper&#8230;<\/p>\n","protected":false},"author":1,"featured_media":12143,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/12142"}],"collection":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=12142"}],"version-history":[{"count":0,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/12142\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/media\/12143"}],"wp:attachment":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=12142"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=12142"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=12142"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}