{"id":10638,"date":"2022-03-19T18:00:32","date_gmt":"2022-03-19T18:00:32","guid":{"rendered":"http:\/\/TheNextWeb=1382807"},"modified":"2022-03-19T18:00:32","modified_gmt":"2022-03-19T18:00:32","slug":"neuro-symbolic-ai-brings-us-closer-to-machines-with-common-sense","status":"publish","type":"post","link":"https:\/\/www.londonchiropracter.com\/?p=10638","title":{"rendered":"Neuro-symbolic AI brings us closer to machines with common sense"},"content":{"rendered":"\n<p><em>This article is part of our coverage of the latest in <a href=\"https:\/\/bdtechtalks.com\/tag\/ai-research-papers\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">AI research<\/a>.<\/em><\/p>\n<p>Artificial intelligence research has made great achievements in solving specific applications, but we\u2019re still far from the kind of <a href=\"https:\/\/bdtechtalks.com\/2020\/05\/13\/what-is-artificial-general-intelligence-agi\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">general-purpose AI systems<\/a> that scientists have been dreaming of for decades.<\/p>\n<p>Among the solutions being explored to overcome the barriers of AI is the idea of <a href=\"https:\/\/bdtechtalks.com\/2019\/06\/05\/mit-ibm-hybrid-ai\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">neuro-symbolic systems<\/a> that bring together the best of different branches of computer science. In a <a href=\"https:\/\/video.ibm.com\/recorded\/131288167\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">talk<\/a> at the IBM Neuro-Symbolic AI Workshop, Joshua Tenenbaum, professor of computational cognitive science at the Massachusetts Institute of Technology, explained how neuro-symbolic systems can help to address some of the key problems of current AI systems.<\/p>\n<p>Among the many gaps in AI, Tenenbaum is focused on one in particular: \u201cHow do we go beyond the idea of intelligence as recognizing patterns in data and approximating functions and more toward the idea of all the things the human mind does when you\u2019re modeling the world, explaining and understanding the things you\u2019re seeing, imagining things that you can\u2019t see but could happen, and making them into goals that you can achieve by planning actions and solving problems?\u201d<\/p>\n<p>Admittedly, that is a big gap, but bridging it starts with exploring one of the fundamental aspects of intelligence that humans and many animals share: intuitive physics and psychology.<\/p>\n<h2>Intuitive physics and psychology<\/h2>\n<p>Our minds are built not just to see patterns in pixels and soundwaves but to <a href=\"https:\/\/bdtechtalks.com\/2022\/03\/07\/yann-lecun-ai-self-supervised-learning\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">understand the world through models<\/a>. As humans, we start developing these models as early as three months of age, by observing and acting in the world.<\/p>\n<p>We break down the world into objects and agents, and interactions between these objects and agents. Agents have their own goals and their own models of the world (which might be different from ours).<\/p>\n<p>For example, <a href=\"https:\/\/sites.lsa.umich.edu\/warneken\/study-videos\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">multiple studies<\/a> by researchers Felix Warneken and Michael Tomasello show that children develop abstract ideas about the physical world and other people and apply them in novel situations. For example, in the following video, through observation alone, the child realizes that the person holding the objects has a goal in mind and needs help with opening the door to the closet.<\/p>\n<p>These capabilities are often referred to as <a href=\"https:\/\/bdtechtalks.com\/2020\/06\/01\/artificial-intelligence-computer-vision-fpicu\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">\u201cintuitive physics\u201d and \u201cintuitive psychology\u201d<\/a> or \u201ctheory of mind,\u201d and they are at the heart of common sense.<\/p>\n<p>\u201cThese systems develop quite early in the brain architecture that is to some extent shared with other species,\u201d Tenenbaum says. These cognitive systems are the bridge between all the other parts of intelligence such as the targets of perception, the substrate of action-planning, reasoning, and even language.<\/p>\n<p>AI agents should be able to reason and plan their actions based on mental representations they develop of the world and other agents through intuitive physics and theory of mind.<\/p>\n<h2>Neuro-symbolic architecture<\/h2>\n<p><figure class=\"post-image post-mediaBleed aligncenter\"><img decoding=\"async\" loading=\"lazy\" class=\"aligncenter size-featured_img wp-image-1382811 js-lazy\" src=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/machine-learning-causality-796x448.jpeg\" alt=\"machine-learning-causality\" width=\"796\" height=\"448\" sizes=\"(max-width: 796px) 100vw, 796px\" data-srcset=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/machine-learning-causality-796x448.jpeg 796w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/machine-learning-causality-280x158.jpeg 280w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/machine-learning-causality-240x135.jpeg 240w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/machine-learning-causality-480x270.jpeg 480w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/machine-learning-causality-1200x675.jpeg 1200w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/machine-learning-causality.jpeg 1392w\"><noscript><img decoding=\"async\" loading=\"lazy\" class=\"aligncenter size-featured_img wp-image-1382811\" src=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/machine-learning-causality-796x448.jpeg\" alt=\"machine-learning-causality\" width=\"796\" height=\"448\" srcset=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/machine-learning-causality-796x448.jpeg 796w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/machine-learning-causality-280x158.jpeg 280w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/machine-learning-causality-240x135.jpeg 240w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/machine-learning-causality-480x270.jpeg 480w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/machine-learning-causality-1200x675.jpeg 1200w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/machine-learning-causality.jpeg 1392w\"><\/noscript><\/figure>\n<\/p>\n<p>Tenenbaum lists three components required to create the core for intuitive physics and psychology in AI.<\/p>\n<p>\u201cWe emphasize a three-way interaction between neural, symbolic, and probabilistic modeling and inference,\u201d Tenenbaum says. \u201cWe think that it\u2019s that three-way combination that is needed to capture human-like intelligence and core common sense.\u201d<\/p>\n<p>The <a href=\"https:\/\/bdtechtalks.com\/2019\/11\/18\/what-is-symbolic-artificial-intelligence\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">symbolic component<\/a> is used to represent and reason with abstract knowledge. The probabilistic inference model helps establish causal relations between different entities, reason about counterfactuals and unseen scenarios, and deal with uncertainty. And the neural component uses pattern recognition to map real-world sensory data to knowledge and to help navigate search spaces.<\/p>\n<p>\u201cWe\u2019re trying to bring together the power of symbolic languages for knowledge representation and reasoning as well as neural networks and the things that they\u2019re good at, but also with the idea of probabilistic inference, especially Bayesian inference or inverse inference in a causal model for reasoning backwards from the things we can observe to the things we want to infer, like the underlying physics of the world, or the mental states of agents,\u201d Tenenbaum says.<\/p>\n<h2>The game engine in the head<\/h2>\n<p>One of the key components in Tenenbaum\u2019s neuro-symbolic AI concept is a physics simulator that helps predict the outcome of actions. Physics simulators are quite common in game engines and different branches of <a href=\"https:\/\/bdtechtalks.com\/2021\/04\/26\/reinforcement-learning-embodied-ai\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">reinforcement learning and robotics<\/a>.<\/p>\n<p>But unlike other branches of AI that use simulators to train agents and transfer their learnings to the real world, Tenenbaum\u2019s idea is to integrate the simulator into the agent\u2019s inference and reasoning process.<\/p>\n<p>\u201cThat\u2019s why we call it the game engine in the head,\u201d he says.<\/p>\n<figure class=\"post-image post-mediaBleed aligncenter\"><img decoding=\"async\" loading=\"lazy\" class=\"size-featured_img wp-image-1382812 js-lazy\" src=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/pybullet-rigid-body-physics-simulator-796x497.jpeg\" alt=\"Physics simulator enable AI agents to imagine and predict outcomes in the real world\" width=\"796\" height=\"497\" sizes=\"(max-width: 796px) 100vw, 796px\" data-srcset=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/pybullet-rigid-body-physics-simulator-796x497.jpeg 796w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/pybullet-rigid-body-physics-simulator-280x175.jpeg 280w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/pybullet-rigid-body-physics-simulator-216x135.jpeg 216w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/pybullet-rigid-body-physics-simulator-432x270.jpeg 432w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/pybullet-rigid-body-physics-simulator.jpeg 1392w\"><figcaption><a href=\"https:\/\/thenextweb.com\/news\/neuro-symbolic-ai-closer-machines-with-common-sense#\" data-url=\"https:\/\/twitter.com\/intent\/tweet?url=https%3A%2F%2Feditorial.thenextweb.com%2Fneural%2F2022%2F03%2F19%2Fneuro-symbolic-ai-closer-machines-with-common-sense%2F&amp;via=thenextweb&amp;related=thenextweb&amp;text=Check out this picture on: Physics simulator enable AI agents to imagine and predict outcomes in the real world\" data-title=\"Share Physics simulator enable AI agents to imagine and predict outcomes in the real world on Twitter\" data-width=\"685\" data-height=\"500\" class=\"post-image-share popitup\" title=\"Share Physics simulator enable AI agents to imagine and predict outcomes in the real world on Twitter\"><i class=\"icon icon--inline icon--twitter--dark\"><\/i><\/a>Physics simulator enable AI agents to imagine and predict outcomes in the real world<\/figcaption><noscript><img decoding=\"async\" loading=\"lazy\" class=\"size-featured_img wp-image-1382812\" src=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/pybullet-rigid-body-physics-simulator-796x497.jpeg\" alt=\"Physics simulator enable AI agents to imagine and predict outcomes in the real world\" width=\"796\" height=\"497\" srcset=\"https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/pybullet-rigid-body-physics-simulator-796x497.jpeg 796w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/pybullet-rigid-body-physics-simulator-280x175.jpeg 280w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/pybullet-rigid-body-physics-simulator-216x135.jpeg 216w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/pybullet-rigid-body-physics-simulator-432x270.jpeg 432w, https:\/\/cdn0.tnwcdn.com\/wp-content\/blogs.dir\/1\/files\/2022\/03\/pybullet-rigid-body-physics-simulator.jpeg 1392w\"><\/noscript><\/figure>\n<p>The physics engine will help the AI simulate the world in real-time and predict what will happen in the future. The simulation just needs to be reasonably accurate and help the agent choose a promising course of action. This is similar to how the human mind works as well. When we look at an image, such as a stack of blocks, we will have a rough idea of whether it will resist gravity or topple. Or if we see a set of blocks on a table and are asked what will happen if we give the table a sudden bump, we can roughly predict which blocks will fall.<\/p>\n<p>We might not be able to predict the exact trajectory of each object, but we develop a high-level idea of the outcome. When combined with a symbolic inference system, the simulator can be configurated to test various possible simulations at a very fast rate.<\/p>\n<h2>Approximating 3D scenes<\/h2>\n<p>While simulators are a great tool, one of their big challenges is that we don\u2019t perceive the world in terms of three-dimensional objects. The neuro-symbolic system must detect the position and orientation of the objects in the scene to create an approximate 3D representation of the world.<\/p>\n<p>There are several attempts to use pure deep learning for object position and pose detection, but their accuracy is low. In a joint project, MIT and IBM created \u201c<a href=\"https:\/\/mitibmwatsonailab.mit.edu\/research\/blog\/3dp3-3d-scene-perception-via-probabilistic-programming\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">3D Scene Perception via Probabilistic Programming<\/a>\u201d (3DP3), a system that resolves many of the errors that pure deep learning systems fall into.<\/p>\n<p>3DP3 takes an image and tries to explain it through 3D volumes that capture each object. It feeds the objects into a symbolic scene graph that specifies the contact and support relations between them. And then it tries to reconstruct the original image and depth map to compare against the ground truth.<\/p>\n<figure class=\"post-image post-mediaBleed aligncenter\"><a href=\"https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?ssl=1\" target=\"_blank\" rel=\"nofollow noopener noreferrer\"><img decoding=\"async\" loading=\"lazy\" class=\"jetpack-js-lazy-image jetpack-js-lazy-image--handled wp-image-13184 js-lazy\" src=\"https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?resize=696%2C131&amp;ssl=1\" sizes=\"(max-width: 696px) 100vw, 696px\" alt=\"3D Scene Perception via Probabilistic Programming (3DP3)\" width=\"696\" height=\"131\" data-attachment-id=\"13184\" data-permalink=\"https:\/\/bdtechtalks.com\/2022\/03\/14\/neuro-symbolic-ai-common-sense\/3d-scene-perception-via-probabilistic-programming-3dp3\/\" data-orig-file=\"https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?fit=2094%2C394&amp;ssl=1\" data-orig-size=\"2094,394\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;1&quot;}\" data-image-title=\"3D Scene Perception via Probabilistic Programming (3DP3)\" data-image-description data-image-caption=\"\n\n<p>3D Scene Perception via Probabilistic Programming (3DP3) uses neural networks, symbolic inference, and probabilistic models to create 3D representations of images.<\/p>\n<p>&#8221; data-medium-file=&#8221;https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?fit=300%2C56&amp;ssl=1&#8243; data-large-file=&#8221;https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?fit=696%2C131&amp;ssl=1&#8243; data-recalc-dims=&#8221;1&#8243; data-lazy-loaded=&#8221;1&#8243; data-srcset=&#8221;https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?resize=1024%2C193&amp;ssl=1 1024w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?resize=300%2C56&amp;ssl=1 300w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?resize=768%2C145&amp;ssl=1 768w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?resize=1536%2C289&amp;ssl=1 1536w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?resize=2048%2C385&amp;ssl=1 2048w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?resize=696%2C131&amp;ssl=1 696w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?resize=1068%2C201&amp;ssl=1 1068w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?resize=1920%2C361&amp;ssl=1 1920w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?w=1392&amp;ssl=1 1392w&#8221;><noscript><img decoding=\"async\" loading=\"lazy\" class=\"jetpack--image jetpack--image--handled wp-image-13184\" src=\"https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?resize=696%2C131&amp;ssl=1\" alt=\"3D Scene Perception via Probabilistic Programming (3DP3)\" width=\"696\" height=\"131\" data-attachment-id=\"13184\" data-permalink=\"https:\/\/bdtechtalks.com\/2022\/03\/14\/neuro-symbolic-ai-common-sense\/3d-scene-perception-via-probabilistic-programming-3dp3\/\" data-orig-file=\"https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?fit=2094%2C394&amp;ssl=1\" data-orig-size=\"2094,394\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;1&quot;}\" data-image-title=\"3D Scene Perception via Probabilistic Programming (3DP3)\" data-image-description data-image-caption=\"\n\n<p>3D Scene Perception via Probabilistic Programming (3DP3) uses neural networks, symbolic inference, and probabilistic models to create 3D representations of images.<\/p>\n<p>&#8221; data-medium-file=&#8221;https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?fit=300%2C56&amp;ssl=1&#8243; data-large-file=&#8221;https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?fit=696%2C131&amp;ssl=1&#8243; data-recalc-dims=&#8221;1&#8243; data-lazy-loaded=&#8221;1&#8243; srcset=&#8221;https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?resize=1024%2C193&amp;ssl=1 1024w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?resize=300%2C56&amp;ssl=1 300w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?resize=768%2C145&amp;ssl=1 768w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?resize=1536%2C289&amp;ssl=1 1536w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?resize=2048%2C385&amp;ssl=1 2048w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?resize=696%2C131&amp;ssl=1 696w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?resize=1068%2C201&amp;ssl=1 1068w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?resize=1920%2C361&amp;ssl=1 1920w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/3D-Scene-Perception-via-Probabilistic-Programming-3DP3.jpg?w=1392&amp;ssl=1 1392w&#8221;><\/noscript><\/a><figcaption><a href=\"https:\/\/thenextweb.com\/news\/neuro-symbolic-ai-closer-machines-with-common-sense#\" data-url=\"https:\/\/twitter.com\/intent\/tweet?url=https%3A%2F%2Feditorial.thenextweb.com%2Fneural%2F2022%2F03%2F19%2Fneuro-symbolic-ai-closer-machines-with-common-sense%2F&amp;via=thenextweb&amp;related=thenextweb&amp;text=Check out this picture on: 3D Scene Perception via Probabilistic Programming (3DP3) uses neural networks, symbolic inference, and probabilistic models to create 3D representations of images. arXiv\" data-title=\"Share 3D Scene Perception via Probabilistic Programming (3DP3) uses neural networks, symbolic inference, and probabilistic models to create 3D representations of images. arXiv on Twitter\" data-width=\"685\" data-height=\"500\" class=\"post-image-share popitup\" title=\"Share 3D Scene Perception via Probabilistic Programming (3DP3) uses neural networks, symbolic inference, and probabilistic models to create 3D representations of images. arXiv on Twitter\"><i class=\"icon icon--inline icon--twitter--dark\"><\/i><\/a>3D Scene Perception via Probabilistic Programming (3DP3) uses neural networks, symbolic inference, and probabilistic models to create 3D representations of images. <a href=\"https:\/\/arxiv.org\/pdf\/2111.00312.pdf\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">arXiv<\/a><\/figcaption><\/figure>\n<h2>Thinking about solutions<\/h2>\n<p>Once the neuro-symbolic agent has a physics engine to model the world, it should be able to develop concepts that enable it to act in novel ways.<\/p>\n<p>For example, people (and sometimes animals) can learn to use a new tool to solve a problem or figure out how to repurpose a known object for a new goal (e.g., use a rock instead of a hammer to drive in a nail).<\/p>\n<p>For this, Tenenbaum and his colleagues developed <a href=\"https:\/\/www.pnas.org\/doi\/abs\/10.1073\/pnas.1912341117\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">a physics simulator<\/a> in which people would have to use objects to solve problems in novel ways. The same engine was used to train AI models to develop abstract concepts about using objects.<\/p>\n<figure class=\"post-image post-mediaBleed aligncenter\"><a href=\"https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/humans-animals-tool-use-physics-simulator.jpg?ssl=1\" target=\"_blank\" rel=\"nofollow noopener noreferrer\"><img decoding=\"async\" loading=\"lazy\" class=\"jetpack-js-lazy-image jetpack-js-lazy-image--handled wp-image-13186 js-lazy\" src=\"https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/humans-animals-tool-use-physics-simulator.jpg?resize=629%2C395&amp;ssl=1\" sizes=\"(max-width: 629px) 100vw, 629px\" alt=\"humans animals tool use physics simulator\" width=\"629\" height=\"395\" data-attachment-id=\"13186\" data-permalink=\"https:\/\/bdtechtalks.com\/2022\/03\/14\/neuro-symbolic-ai-common-sense\/humans-animals-tool-use-physics-simulator\/\" data-orig-file=\"https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/humans-animals-tool-use-physics-simulator.jpg?fit=838%2C526&amp;ssl=1\" data-orig-size=\"838,526\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;1&quot;}\" data-image-title=\"humans animals tool use physics simulator\" data-image-description data-image-caption=\"\n\n<p>Humans and animals can intuitively find new to use tools in novel ways (source: PNAS)<\/p>\n<p>&#8221; data-medium-file=&#8221;https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/humans-animals-tool-use-physics-simulator.jpg?fit=300%2C188&amp;ssl=1&#8243; data-large-file=&#8221;https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/humans-animals-tool-use-physics-simulator.jpg?fit=696%2C437&amp;ssl=1&#8243; data-recalc-dims=&#8221;1&#8243; data-lazy-loaded=&#8221;1&#8243; data-srcset=&#8221;https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/humans-animals-tool-use-physics-simulator.jpg?w=838&amp;ssl=1 838w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/humans-animals-tool-use-physics-simulator.jpg?resize=300%2C188&amp;ssl=1 300w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/humans-animals-tool-use-physics-simulator.jpg?resize=768%2C482&amp;ssl=1 768w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/humans-animals-tool-use-physics-simulator.jpg?resize=696%2C437&amp;ssl=1 696w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/humans-animals-tool-use-physics-simulator.jpg?resize=669%2C420&amp;ssl=1 669w&#8221;><noscript><img decoding=\"async\" loading=\"lazy\" class=\"jetpack--image jetpack--image--handled wp-image-13186\" src=\"https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/humans-animals-tool-use-physics-simulator.jpg?resize=629%2C395&amp;ssl=1\" alt=\"humans animals tool use physics simulator\" width=\"629\" height=\"395\" data-attachment-id=\"13186\" data-permalink=\"https:\/\/bdtechtalks.com\/2022\/03\/14\/neuro-symbolic-ai-common-sense\/humans-animals-tool-use-physics-simulator\/\" data-orig-file=\"https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/humans-animals-tool-use-physics-simulator.jpg?fit=838%2C526&amp;ssl=1\" data-orig-size=\"838,526\" data-comments-opened=\"1\" data-image-meta=\"{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;1&quot;}\" data-image-title=\"humans animals tool use physics simulator\" data-image-description data-image-caption=\"\n\n<p>Humans and animals can intuitively find new to use tools in novel ways (source: PNAS)<\/p>\n<p>&#8221; data-medium-file=&#8221;https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/humans-animals-tool-use-physics-simulator.jpg?fit=300%2C188&amp;ssl=1&#8243; data-large-file=&#8221;https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/humans-animals-tool-use-physics-simulator.jpg?fit=696%2C437&amp;ssl=1&#8243; data-recalc-dims=&#8221;1&#8243; data-lazy-loaded=&#8221;1&#8243; srcset=&#8221;https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/humans-animals-tool-use-physics-simulator.jpg?w=838&amp;ssl=1 838w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/humans-animals-tool-use-physics-simulator.jpg?resize=300%2C188&amp;ssl=1 300w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/humans-animals-tool-use-physics-simulator.jpg?resize=768%2C482&amp;ssl=1 768w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/humans-animals-tool-use-physics-simulator.jpg?resize=696%2C437&amp;ssl=1 696w, https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/humans-animals-tool-use-physics-simulator.jpg?resize=669%2C420&amp;ssl=1 669w&#8221;><\/noscript><\/a><figcaption><a href=\"https:\/\/thenextweb.com\/news\/neuro-symbolic-ai-closer-machines-with-common-sense#\" data-url=\"https:\/\/twitter.com\/intent\/tweet?url=https%3A%2F%2Feditorial.thenextweb.com%2Fneural%2F2022%2F03%2F19%2Fneuro-symbolic-ai-closer-machines-with-common-sense%2F&amp;via=thenextweb&amp;related=thenextweb&amp;text=Check out this picture on: Humans and animals can intuitively find new to use tools in novel ways. PNAS\" data-title=\"Share Humans and animals can intuitively find new to use tools in novel ways. PNAS on Twitter\" data-width=\"685\" data-height=\"500\" class=\"post-image-share popitup\" title=\"Share Humans and animals can intuitively find new to use tools in novel ways. PNAS on Twitter\"><i class=\"icon icon--inline icon--twitter--dark\"><\/i><\/a>Humans and animals can intuitively find new to use tools in novel ways. PNAS<\/figcaption><\/figure>\n<p>\u201cWhat\u2019s important is to develop higher-level strategies that might transfer in new situations. This is where the symbolic approach becomes key,\u201d Tenenbaum says.<\/p>\n<p>For example, people can use abstract concepts such as \u201chammer\u201d and \u201ccatapult\u201d and use them to solve different problems.<\/p>\n<p>\u201cPeople can form these abstract concepts and transfer them to near and far situations. We can model this through a program that can describe these concepts symbolically,\u201d Tenenbaum says.<\/p>\n<p>In one of their projects, Tenenbaum and hi AI system was able to parse a scene and use a probabilistic model that produce a step-by-step set of symbolic instructions to solve physics problems. For example, to throw an object placed on a board, the system was able to figure out that it had to find a large object, place it high above the opposite end of the board, and drop it to create a catapult effect.<\/p>\n<p><figure class=\"post-image post-mediaBleed aligncenter\"><img decoding=\"async\" class=\"aligncenter js-lazy\" src=\"https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/catapult-concept.jpg?resize=696%2C326&amp;ssl=1\" alt=\"catapult concept\"><noscript><img decoding=\"async\" class=\"aligncenter\" src=\"https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2022\/03\/catapult-concept.jpg?resize=696%2C326&amp;ssl=1\" alt=\"catapult concept\"><\/noscript><\/figure>\n<\/p>\n<h2>Physically grounded language<\/h2>\n<p>Until now, while we talked a lot about symbols and concepts, there was no mention of language. Tenenbaum explained in his talk that <a href=\"https:\/\/bdtechtalks.com\/2021\/07\/12\/linguistics-for-the-age-of-ai\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">language is deeply grounded in the unspoken commonsense knowledge<\/a> that we acquire before we learn to speak.<\/p>\n<p>Intuitive physics and theory of mind are missing from current natural language processing systems. <a href=\"https:\/\/bdtechtalks.com\/2021\/12\/20\/artificial-intelligence-large-language-understanding\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Large language models<\/a>, the currently popular approach to natural language processing and understanding, tries to capture relevant patterns between sequences of words by examining very large corpora of text. While this method has produced impressive results, it also has limits when it comes to dealing with things that are not represented in the statistical regularities of words and sentences.<\/p>\n<p>\u201cThere have been tremendous advances in large language models, but because they don\u2019t have a grounding in physics and theory of mind, in some ways they are quite limited,\u201d Tenenbaum says. \u201cAnd you can see this in their limits in understanding symbolic scenes. They also don\u2019t have a sense of physics. Verbs often refer to causal structures. You have to be able to capture counterfactuals and they have to be probabilistic if you want to make judgments.\u201d<\/p>\n<p><figure class=\"post-image post-mediaBleed aligncenter\"><img decoding=\"async\" class=\"aligncenter js-lazy\" src=\"https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2021\/12\/large-language-models.jpg?resize=696%2C435&amp;ssl=1\" alt=\"large language models\"><noscript><img decoding=\"async\" class=\"aligncenter\" src=\"https:\/\/i0.wp.com\/bdtechtalks.com\/wp-content\/uploads\/2021\/12\/large-language-models.jpg?resize=696%2C435&amp;ssl=1\" alt=\"large language models\"><\/noscript><\/figure>\n<\/p>\n<h2>The building blocks of common sense<\/h2>\n<p>So far, many of the successful approaches in neuro-symbolic AI provide the models with prior knowledge of intuitive physics such as dimensional consistency and translation invariance. One of the main challenges that remain is how to design AI systems that learn these intuitive physics concepts as children do. The learning space of physics engines is much more complicated than the weight space of <a href=\"https:\/\/bdtechtalks.com\/2021\/01\/28\/deep-learning-explainer\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">traditional neural networks<\/a>, which means that we still need to find new techniques for learning.<\/p>\n<p>Tenenbaum also discusses the way humans develop building blocks of knowledge in a paper titled \u201c<a href=\"https:\/\/www.cell.com\/trends\/cognitive-sciences\/fulltext\/S1364-6613(20)30174-1\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">The Child as a Hacker<\/a>.\u201d In the paper, Tenenbaum and his co-authors use programming as an example of how humans explore solutions across different dimensions such as accuracy, efficiency, usefulness, modularity, etc. They also discuss how humans gather bits of information, develop them into new symbols and concepts, and then learn to combine them together to form new concepts. These directions of research might help crack the code of common sense in neuro-symbolic AI.<\/p>\n<p>\u201cWe want to provide a roadmap of how to achieve the vision of thinking about what is it that makes human common sense distinctive and powerful from the very beginning,\u201d Tenenbaum says. \u201cIn a sense, it is one of AI\u2019s oldest dreams going back to Alan Turing\u2019s original proposal for intelligence as computation and the idea that we might build a machine that achieves human-level intelligence by starting like a baby and teaching it like a child. This has been inspirational for a number of us and what we\u2019re trying to do is come up with the building blocks for that.\u201d<\/p>\n<div class=\"c-richText c-richText--large\" readability=\"38.531073446328\">\n<p><em>This article was originally published by Ben Dickson on<span>&nbsp;<\/span><a href=\"https:\/\/bdtechtalks.com\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">TechTalks<\/a>, a publication that examines trends in technology, how they affect the way we live and do business, and the problems they solve. But we also discuss the evil side of technology, the darker implications of new tech, and what we need to look out for. You can read the original article <a href=\"https:\/\/bdtechtalks.com\/2022\/03\/14\/neuro-symbolic-ai-common-sense\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">here<\/a><\/em><\/p>\n<\/div>\n<p> <a href=\"https:\/\/thenextweb.com\/news\/neuro-symbolic-ai-closer-machines-with-common-sense\">Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>This article is part of our coverage of the latest in AI research. Artificial intelligence research has made great achievements in solving specific applications, but we\u2019re still far from the kind of&#8230;<\/p>\n","protected":false},"author":1,"featured_media":10639,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/10638"}],"collection":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=10638"}],"version-history":[{"count":0,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/10638\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/media\/10639"}],"wp:attachment":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=10638"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=10638"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=10638"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}