{"id":316138,"date":"2019-05-12T15:30:38","date_gmt":"2019-05-12T13:30:38","guid":{"rendered":"https:\/\/businesstech.co.za\/news\/?p=316138"},"modified":"2019-05-10T15:54:58","modified_gmt":"2019-05-10T13:54:58","slug":"ai-develops-human-like-number-sense-taking-us-a-step-closer-to-building-machines-with-general-intelligence","status":"publish","type":"post","link":"https:\/\/businesstech.co.za\/news\/technology\/316138\/ai-develops-human-like-number-sense-taking-us-a-step-closer-to-building-machines-with-general-intelligence\/","title":{"rendered":"AI develops human-like number sense \u2013 taking us a step closer to building machines with general intelligence"},"content":{"rendered":"<p>Numbers figure pretty high up on the list of what a computer can do well. While humans often struggle to split a restaurant bill, a modern computer can make millions of calculations in a mere second. Humans, however, have an innate and intuitive number sense that helped us, among other things, to build computers in the first place.<\/p>\n<p>Unlike a computer, a human knows when looking at four cats, four apples and the symbol 4 that they all have one thing in common \u2013 the abstract concept of \u201cfour\u201d \u2013 without even having to count them. This illustrates the difference between the human mind and the machine, and helps explain why we are <a href=\"https:\/\/theconversation.com\/worried-about-ai-taking-over-the-world-you-may-be-making-some-rather-unscientific-assumptions-103561\">not even close<\/a> to developing AIs with the broad intelligence that humans possess. But now a new study, <a href=\"https:\/\/advances.sciencemag.org\/content\/5\/5\/eaav7903\">published in Science Advances<\/a>, reports that an AI has spontaneously developed a human-like number sense.<\/p>\n<p>For a computer to count, we must clearly define what the thing is we want to count. Once we allocate a bit of memory to maintain the counter, we can set it to zero and then add an item each time we find something we want to record. This means that computers can count time (signals from an electronic clock), words (if stored in the computer\u2019s memory) and even objects in a digital image.<\/p>\n<p>This last task, however, is a bit challenging, as we have to tell the computer exactly <a href=\"https:\/\/theconversation.com\/breast-cancer-diagnosis-by-ai-now-as-good-as-human-experts-115487\">what the objects look like<\/a> before it can count them. But objects don\u2019t always look the same \u2013 variation in lighting, position and pose have an impact, as well as any differences in construction between individual examples.<\/p>\n<p>All the successful computational approaches to detecting objects in images work by building up a kind of statistical picture of an object from many individual examples \u2013 a type of learning. This allows the computer to recognise new versions of objects with some degree of confidence. The training involves offering examples that do, or do not, contain the object. The computer then makes a guess as to whether it does, and adjusts its statistical model according to the accuracy of the guess \u2013 as judged by a <a href=\"https:\/\/en.wikipedia.org\/wiki\/Supervised_learning\">human supervising the learning<\/a>.<\/p>\n<p>Modern AI systems automatically start to being able to detect objects when provided with millions of training images of any sort \u2013 just like humans do. These <a href=\"https:\/\/www.mathworks.com\/discovery\/unsupervised-learning.html\">unsupervised learning systems<\/a> gradually notice parts of the elements in the images that are often present at the same time, and build up layer upon layer of more complicated commonalities.<\/p>\n<p>Take recognising apples as an example. As images containing all manner of shapes are presented to the system, it first begins to notice groups of pixels that make up horizontal and vertical lines, and left and right curves. They\u2019re present in apples, faces, cats and cars, so the commonalities, or abstractions, are found early on. It eventually realises that certain curves and lines are often present together in apples \u2013 and develops a new, deeper level abstraction that represents a class of objects: apples, in this case.<\/p>\n<p><strong>Deep learning<\/strong><\/p>\n<p>This natural emergence of high-level abstractions is one of the most exciting results of the machine learning technique called <a href=\"https:\/\/en.wikipedia.org\/wiki\/Deep_learning\">deep neural networks<\/a>, which in some sense work in a similar way to the human brain. The \u201cdepth\u201d comes from the <a href=\"https:\/\/theconversation.com\/deep-learning-could-prevent-you-from-drunk-posting-to-facebook-35435\">many layers in the network<\/a> \u2013 as the information goes deeper into the network, the commonalities found become more abstract. In this way, networks are created with elements that are strongly active when the input is similar to what it has experienced before. The most abstract things appear at the deepest levels \u2013 these are cats, faces and apples rather than vertical lines or circles.<\/p>\n<p>When an AI system can recognise apples, you can then use it to count how many there are. That\u2019s great, yet it\u2019s not quite how you or I would count apples. We have an extremely deep concept of \u201cnumber\u201d \u2013 how many of something there is. Rather than just being active when an object is present, parts of our brain activate depending on the amount of objects present. It means we can look at a bunch of apples and know that there are four without actually counting each one.<\/p>\n<p>In fact, many animals can do this too. That\u2019s because this sense of numerosity is a useful trait for survival and reproduction in a lot of different situations \u2013 take for instance judging the size of groups of rivals or prey.<\/p>\n<p><a  data-lightbox=\"post-image\" href=\"https:\/\/businesstech.co.za\/news\/wp-content\/uploads\/2019\/05\/AI.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-316140\" src=\"https:\/\/businesstech.co.za\/news\/wp-content\/uploads\/2019\/05\/AI.jpg\" alt=\"\" width=\"754\" height=\"410\" srcset=\"https:\/\/businesstech.co.za\/news\/wp-content\/uploads\/2019\/05\/AI.jpg 754w, https:\/\/businesstech.co.za\/news\/wp-content\/uploads\/2019\/05\/AI-300x163.jpg 300w\" sizes=\"auto, (max-width: 754px) 100vw, 754px\" \/><\/a><\/p>\n<p><strong>Emergent properties<\/strong><\/p>\n<p>In the new study, a deep neural network that was trained for simple visual object detection spontaneously developed this kind of number sense. The researchers discovered that specific units within the network suddenly \u201ctuned\u201d to an abstract number \u2013 just like real neurons in the brain might respond. It realised that a picture of four apples is similar to a picture of four cats \u2013 because they have \u201cfour\u201d in common.<\/p>\n<p>One really exciting thing about this research is that it shows that our current principles of learning are quite fundamental. Some of the most high-level aspects of thinking that people and animals demonstrate are related deeply to the structure of the world, and our visual experience of that.<\/p>\n<p>It also hints that we might be on the right track to achieve a more comprehensive, human-level artificial intelligence. Applying this kind of learning to other tasks \u2013 perhaps applying it to signals that occur over a period of time rather than over pixels in an image \u2013 could yield machines with even <a href=\"https:\/\/theconversation.com\/will-ai-ever-understand-human-emotions-70960\">more human-like qualities<\/a>. Things we once thought fundamental to being human \u2013 <a href=\"https:\/\/musically.com\/2019\/04\/04\/strictly-algo-rhythm-ai-music-is-nothing-to-be-scared-of\/\">musical rhythm<\/a> for example, or even a <a href=\"https:\/\/phys.org\/news\/2018-06-artificial-intelligence-causation.html\">sense of causality<\/a> \u2013 are now being examined from this new perspective.<\/p>\n<p>As we continue to discover more about building artificial learning techniques, and find new ways to understand the brains of living organisms, we unlock more of the mysteries of intelligent, adaptive behaviour.<\/p>\n<p>There\u2019s a long way to go, and many other dimensions <a href=\"https:\/\/theconversation.com\/why-ai-cant-solve-everything-97022\">that we need to explore<\/a>, but it\u2019s clear that the capability to look at the world and work out its structure from experience is a key part of what makes humans so adaptable. There\u2019s no doubt it will be a necessary component of any AI system that has the potential to perform the variety and complexity of tasks that humans can.<\/p>\n<ul>\n<li><em>By Lecturer in Evolutionary Robotics and Artificial Life, Keele University\u00a0<\/em><\/li>\n<li>Read the full article at the Conversation, <a href=\"https:\/\/theconversation.com\/ai-develops-human-like-number-sense-taking-us-a-step-closer-to-building-machines-with-general-intelligence-116820\" target=\"_blank\" rel=\"noopener noreferrer\">here<\/a><\/li>\n<\/ul>\n<hr \/>\n<p><strong>Read: <a href=\"https:\/\/businesstech.co.za\/news\/business\/311888\/these-south-african-jobs-will-start-to-disappear-as-technology-takes-over\/\" target=\"_blank\" rel=\"noopener noreferrer\">These South African jobs will disappear as technology takes over<\/a><\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Numbers figure pretty high up on the list of what a computer can do well. While humans often struggle to split a restaurant bill, a modern computer can make millions of calculations in a mere second. Humans, however, have an innate and intuitive number sense that helped us, among other things, to build computers in the first place.<\/p>\n","protected":false},"author":29,"featured_media":46097,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[9878],"tags":[26],"class_list":["post-316138","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technology","tag-headline"],"_links":{"self":[{"href":"https:\/\/businesstech.co.za\/news\/wp-json\/wp\/v2\/posts\/316138","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/businesstech.co.za\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/businesstech.co.za\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/businesstech.co.za\/news\/wp-json\/wp\/v2\/users\/29"}],"replies":[{"embeddable":true,"href":"https:\/\/businesstech.co.za\/news\/wp-json\/wp\/v2\/comments?post=316138"}],"version-history":[{"count":2,"href":"https:\/\/businesstech.co.za\/news\/wp-json\/wp\/v2\/posts\/316138\/revisions"}],"predecessor-version":[{"id":316144,"href":"https:\/\/businesstech.co.za\/news\/wp-json\/wp\/v2\/posts\/316138\/revisions\/316144"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/businesstech.co.za\/news\/wp-json\/wp\/v2\/media\/46097"}],"wp:attachment":[{"href":"https:\/\/businesstech.co.za\/news\/wp-json\/wp\/v2\/media?parent=316138"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/businesstech.co.za\/news\/wp-json\/wp\/v2\/categories?post=316138"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/businesstech.co.za\/news\/wp-json\/wp\/v2\/tags?post=316138"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}