{"id":4797,"date":"2021-05-01T10:30:12","date_gmt":"2021-05-01T10:30:12","guid":{"rendered":"https:\/\/editorial.thenextweb.com\/?p=1349090"},"modified":"2021-05-01T10:30:12","modified_gmt":"2021-05-01T10:30:12","slug":"scouring-billions-of-links-for-6-years-showed-us-the-web-is-both-expanding-and-shrinking","status":"publish","type":"post","link":"https:\/\/www.londonchiropracter.com\/?p=4797","title":{"rendered":"Scouring billions of links for 6 years showed us the web is both expanding and shrinking"},"content":{"rendered":"\n<p>The online world is continuously expanding \u2014 always aggregating more services, more users and more activity. Last year, the number of websites registered on the \u201c.com\u201d domain <a href=\"https:\/\/www.verisign.com\/en_US\/channel-resources\/domain-registry-products\/zone-file\/index.xhtml\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">surpassed 150,000,000<\/a>.<\/p>\n<p>However, more than a quarter of a century since its first commercial use, the growth of the online world is now slowing down in some key categories.<\/p>\n<p>We conducted a multi-year research project analyzing global trends in online diversity and dominance. <a href=\"https:\/\/journals.plos.org\/plosone\/article?id=10.1371\/journal.pone.0249993\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Our research<\/a>, published today in Public Library of Science, is the first to reveal some long-term trends in how businesses compete in the age of the web.<\/p>\n<p>We saw a dramatic consolidation of attention towards a shrinking (but increasingly dominant) group of online organisations. So, while there is still growth in the functions, features and applications offered on the web, the number of entities providing these functions is shrinking.<\/p>\n<h2>Web diversity nosedives<\/h2>\n<p>We analysed more than six billion user comments from the social media website Reddit dating back to 2006, as well as 11.8 billion Twitter posts from as far back as 2011. In total, our research used a massive 5.6Tb trove of data from more than a decade of global activity.<\/p>\n<p>This dataset was more than four times the size of the original data from the Hubble Space Telescope, which helped Brian Schmidt and colleagues do their <a href=\"https:\/\/theconversation.com\/nobel-prize-win-tells-us-the-universe-is-accelerating-what-does-that-mean-3753\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Nobel-prize winning work<\/a> in 1998 to prove <a href=\"https:\/\/iopscience.iop.org\/article\/10.1086\/300499\/meta\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">the universe\u2019s expansion is accelerating<\/a>.<\/p>\n<p>With the Reddit posts, we analysed all the links to other sites and online services \u2014 more than one billion in total \u2014 to understand the dynamics of link growth, dominance and diversity through the decade.<\/p>\n<p>We used a measure of link \u201cuniqueness\u201d. On this scale, 1 represents maximum diversity (all links have their own domain) and 0 is minimum diversity (all links are on one domain, such as \u201cyoutube.com\u201d).<\/p>\n<p>A decade ago, there was a much greater variety of domains within links posted by users of Reddit, with more than 20 different domains for every 100 random links users posted. Now there are only about five different domains for every 100 links posted.<\/p>\n<figure class=\"align-center zoomable\" readability=\"2\">\n<p><figure class=\"post-image post-mediaBleed aligncenter\"><a href=\"https:\/\/images.theconversation.com\/files\/395724\/original\/file-20210419-15-1mbwrt5.jpg?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=1000&amp;fit=clip\" target=\"_blank\" rel=\"nofollow noopener noreferrer\"><img decoding=\"async\" loading=\"lazy\" src=\"https:\/\/images.theconversation.com\/files\/395724\/original\/file-20210419-15-1mbwrt5.jpg?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=754&amp;fit=clip\" sizes=\"(min-width: 1466px) 754px, (max-width: 599px) 100vw, (min-width: 600px) 600px, 237px\" alt=\"Web diversity is nosediving.\" width=\"600\" height=\"556\" class=\"lazyreplaced\" srcset=\"https:\/\/images.theconversation.com\/files\/395724\/original\/file-20210419-15-1mbwrt5.jpg?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=600&amp;h=556&amp;fit=crop&amp;dpr=1 600w, https:\/\/images.theconversation.com\/files\/395724\/original\/file-20210419-15-1mbwrt5.jpg?ixlib=rb-1.1.0&amp;q=30&amp;auto=format&amp;w=600&amp;h=556&amp;fit=crop&amp;dpr=2 1200w, https:\/\/images.theconversation.com\/files\/395724\/original\/file-20210419-15-1mbwrt5.jpg?ixlib=rb-1.1.0&amp;q=15&amp;auto=format&amp;w=600&amp;h=556&amp;fit=crop&amp;dpr=3 1800w, https:\/\/images.theconversation.com\/files\/395724\/original\/file-20210419-15-1mbwrt5.jpg?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=754&amp;h=699&amp;fit=crop&amp;dpr=1 754w, https:\/\/images.theconversation.com\/files\/395724\/original\/file-20210419-15-1mbwrt5.jpg?ixlib=rb-1.1.0&amp;q=30&amp;auto=format&amp;w=754&amp;h=699&amp;fit=crop&amp;dpr=2 1508w, https:\/\/images.theconversation.com\/files\/395724\/original\/file-20210419-15-1mbwrt5.jpg?ixlib=rb-1.1.0&amp;q=15&amp;auto=format&amp;w=754&amp;h=699&amp;fit=crop&amp;dpr=3 2262w\"><\/a><figcaption><a href=\"https:\/\/thenextweb.com\/news\/scouring-billions-of-links-for-6-years-showed-us-the-web-is-both-expanding-and-shrinking-syndication#\" data-url=\"https:\/\/twitter.com\/intent\/tweet?url=https%3A%2F%2Feditorial.thenextweb.com%2Finsights%2F2021%2F05%2F01%2Fscouring-billions-of-links-for-6-years-showed-us-the-web-is-both-expanding-and-shrinking-syndication%2F&amp;via=thenextweb&amp;related=thenextweb&amp;text=Check out this picture on: Our Reddit analysis showed the pool of top-performing sources online is shrinking.\" data-title=\"Share Our Reddit analysis showed the pool of top-performing sources online is shrinking. on Twitter\" data-width=\"685\" data-height=\"500\" class=\"post-image-share popitup\" title=\"Share Our Reddit analysis showed the pool of top-performing sources online is shrinking. on Twitter\"><i class=\"icon icon--inline icon--twitter--dark\"><\/i><\/a>Our Reddit analysis showed the pool of top-performing sources online is shrinking.<\/figcaption><\/figure>\n<\/p>\n<\/figure>\n<p>In fact, between 60\u201470% of all attention on key social media platforms is focused towards just ten popular domains.<\/p>\n<p>Beyond social media platforms, we also studied linkage patterns across the web, looking at almost 20 billion links over three years. These results reinforced the \u201crich are getting richer\u201d online.<\/p>\n<p>The authority, influence and visibility of the top 1,000 global websites (as measured by network centrality or PageRank) is growing every month, at the expense of all other sites.<\/p>\n<hr>\n<p><em>Read more:&nbsp;<a href=\"https:\/\/theconversation.com\/the-internets-founder-now-wants-to-fix-the-web-but-his-proposal-misses-the-mark-127793\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">The internet\u2019s founder now wants to \u2018fix the web\u2019, but his proposal misses the mark<\/a><br \/><\/em><\/p>\n<hr>\n<h2>App diversity is on the rise<\/h2>\n<p>The web started as a source of innovation, new ideas and inspiration \u2014 a technology that opened up the playing field. It\u2019s now also becoming a medium that actually stifles competition and promotes monopolies and the dominance of a few players.<\/p>\n<p>Our findings resolve a long-running paradox about the nature of the web: does it help grow businesses, jobs and investment? Or does it make it harder to get ahead by letting anyone and everyone join the game? The answer, it turns out, is it does both.<\/p>\n<p>While the diversity of sources is in decline, there is a countervailing force of continually increasing functionality with new services, products and applications \u2014 such as music streaming services (Spotify), file sharing programs (Dropbox) and messaging platforms (Messenger, Whatsapp and Snapchat).<\/p>\n<figure class=\"align-center zoomable\" readability=\"2\">\n<p><figure class=\"post-image post-mediaBleed aligncenter\"><a href=\"https:\/\/images.theconversation.com\/files\/395731\/original\/file-20210419-21-dgxmnu.jpg?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=1000&amp;fit=clip\" target=\"_blank\" rel=\"nofollow noopener noreferrer\"><img decoding=\"async\" loading=\"lazy\" src=\"https:\/\/images.theconversation.com\/files\/395731\/original\/file-20210419-21-dgxmnu.jpg?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=754&amp;fit=clip\" sizes=\"(min-width: 1466px) 754px, (max-width: 599px) 100vw, (min-width: 600px) 600px, 237px\" alt=\"Functional diversity\" width=\"600\" height=\"405\" class=\"lazyreplaced\" srcset=\"https:\/\/images.theconversation.com\/files\/395731\/original\/file-20210419-21-dgxmnu.jpg?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=600&amp;h=405&amp;fit=crop&amp;dpr=1 600w, https:\/\/images.theconversation.com\/files\/395731\/original\/file-20210419-21-dgxmnu.jpg?ixlib=rb-1.1.0&amp;q=30&amp;auto=format&amp;w=600&amp;h=405&amp;fit=crop&amp;dpr=2 1200w, https:\/\/images.theconversation.com\/files\/395731\/original\/file-20210419-21-dgxmnu.jpg?ixlib=rb-1.1.0&amp;q=15&amp;auto=format&amp;w=600&amp;h=405&amp;fit=crop&amp;dpr=3 1800w, https:\/\/images.theconversation.com\/files\/395731\/original\/file-20210419-21-dgxmnu.jpg?ixlib=rb-1.1.0&amp;q=45&amp;auto=format&amp;w=754&amp;h=509&amp;fit=crop&amp;dpr=1 754w, https:\/\/images.theconversation.com\/files\/395731\/original\/file-20210419-21-dgxmnu.jpg?ixlib=rb-1.1.0&amp;q=30&amp;auto=format&amp;w=754&amp;h=509&amp;fit=crop&amp;dpr=2 1508w, https:\/\/images.theconversation.com\/files\/395731\/original\/file-20210419-21-dgxmnu.jpg?ixlib=rb-1.1.0&amp;q=15&amp;auto=format&amp;w=754&amp;h=509&amp;fit=crop&amp;dpr=3 2262w\"><\/a><figcaption><a href=\"https:\/\/thenextweb.com\/news\/scouring-billions-of-links-for-6-years-showed-us-the-web-is-both-expanding-and-shrinking-syndication#\" data-url=\"https:\/\/twitter.com\/intent\/tweet?url=https%3A%2F%2Feditorial.thenextweb.com%2Finsights%2F2021%2F05%2F01%2Fscouring-billions-of-links-for-6-years-showed-us-the-web-is-both-expanding-and-shrinking-syndication%2F&amp;via=thenextweb&amp;related=thenextweb&amp;text=Check out this picture on: Functional diversity grows continuously online.\" data-title=\"Share Functional diversity grows continuously online. on Twitter\" data-width=\"685\" data-height=\"500\" class=\"post-image-share popitup\" title=\"Share Functional diversity grows continuously online. on Twitter\"><i class=\"icon icon--inline icon--twitter--dark\"><\/i><\/a>Functional diversity grows continuously online.<\/figcaption><\/figure>\n<\/p>\n<\/figure>\n<h2>Website \u2018infant mortality\u2019<\/h2>\n<p>Another major finding was the dramatic increase in the \u201cinfant mortality\u201d rate of websites \u2014 with the big kids on the block guarding their turf more staunchly than ever.<\/p>\n<p>We examined new domains that were continually referenced or linked-to in social media after their first appearance. We found that while almost 40% of the domains created 2006 were active five years on, only a little more than 3% of those created in 2015 remain active today.<\/p>\n<p>The dynamics of online competition are becoming clearer and clearer. And the loss of diversity is concerning. Unlike the natural world, there are no sanctuaries; competition is part of both nature and business.<\/p>\n<p>Our study has profound implications for business leaders, investors and governments everywhere. It shows the network effects of the web don\u2019t just apply to online businesses. They have permeated the entire economy and are rewriting many previously accepted rules of economics.<\/p>\n<p>For example, the idea that businesses can maintain a competitive advantage based on where they are physically located is increasingly tenuous. Meanwhile, there\u2019s new opportunities for companies to set up shop from anywhere in the world and serve a global customer base that\u2019s both mainstream and niche.<\/p>\n<p>The best way to encourage diversity is to have more global online businesses focused on providing diverse services, by addressing consumers\u2019 increasingly niche needs.<\/p>\n<p>In Australia, we\u2019re starting to see this through homegrown companies such as <a href=\"https:\/\/www.canva.com\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Canva<\/a>, <a href=\"https:\/\/safetyculture.com\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">SafetyCulture<\/a> and <a href=\"https:\/\/iwonder.com\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">iWonder<\/a>. Hopefully many more will appear in the decade ahead.<\/p>\n<hr>\n<p><em>Read more:&nbsp;<a href=\"https:\/\/theconversation.com\/if-its-free-online-you-are-the-product-95182\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">If it\u2019s free online, you are the product<\/a><strong><br \/><\/strong><\/em><!-- End of code. If you don't see any code above, please get new code from the Advanced tab after you click the republish button. The page counter does not collect any personal data. More info: https:\/\/theconversation.com\/republishing-guidelines --><\/p>\n<hr>\n<p><em>This article by&nbsp;<a href=\"https:\/\/theconversation.com\/profiles\/paul-x-mccarthy-108227\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Paul X. McCarthy<\/a>, Adjunct Professor, <a href=\"https:\/\/theconversation.com\/institutions\/unsw-1414\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">UNSW<\/a> and <a href=\"https:\/\/theconversation.com\/profiles\/marian-andrei-rizoiu-850922\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">Marian-Andrei Rizoiu<\/a>, Lecturer in Computer Science, <a href=\"https:\/\/theconversation.com\/institutions\/university-of-technology-sydney-936\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">University of Technology Sydney<\/a>,&nbsp;is republished from <a href=\"https:\/\/theconversation.com\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">The Conversation<\/a> under a Creative Commons license. Read the <a href=\"https:\/\/theconversation.com\/we-spent-six-years-scouring-billions-of-links-and-found-the-web-is-both-expanding-and-shrinking-159215\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">original article<\/a>.<\/em><\/p>\n<p> <a href=\"https:\/\/thenextweb.com\/news\/scouring-billions-of-links-for-6-years-showed-us-the-web-is-both-expanding-and-shrinking-syndication\">Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>The online world is continuously expanding \u2014 always aggregating more services, more users and more activity. Last year, the number of websites registered on the \u201c.com\u201d domain surpassed 150,000,000. However, more than&#8230;<\/p>\n","protected":false},"author":1,"featured_media":4798,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/4797"}],"collection":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=4797"}],"version-history":[{"count":0,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/4797\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/media\/4798"}],"wp:attachment":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=4797"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=4797"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=4797"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}