{"id":2332,"date":"2021-01-15T17:00:17","date_gmt":"2021-01-15T17:00:17","guid":{"rendered":"https:\/\/thenextweb.com\/?p=1334307"},"modified":"2021-01-15T17:00:17","modified_gmt":"2021-01-15T17:00:17","slug":"new-self-supervised-ai-models-scan-x-rays-to-predict-prognosis-of-covid-19-patients","status":"publish","type":"post","link":"https:\/\/www.londonchiropracter.com\/?p=2332","title":{"rendered":"New self-supervised AI models scan X-rays to predict prognosis of COVID-19 patients"},"content":{"rendered":"\n<div><img decoding=\"async\" src=\"https:\/\/img-cdn.tnwcdn.com\/image\/neural?filter_last=1&amp;fit=1280%2C640&amp;url=https%3A%2F%2Fcdn0.tnwcdn.com%2Fwp-content%2Fblogs.dir%2F1%2Ffiles%2F2021%2F01%2FUntitled-design-2021-01-15T134250.373.png&amp;signature=16c0e1c446789121fa9cc14628059186\" class=\"ff-og-image-inserted\"><\/div>\n<p>Researchers from Facebook and NYU Langone Health have created AI models that scan X-rays to predict&nbsp;how a COVID-19 patient\u2019s condition will develop.<\/p>\n<p>The team&nbsp;says that their system can forecast whether a patient&nbsp;may need more intensive care resources up to four days in advance. They believe hospitals could use it to&nbsp;anticipate demand for resources and avoid sending at-risk patients home too early.<\/p>\n<p>Their approach differs from most previous attempts to predict COVID-19 deterioration by applying machine learning techniques to X-rays.<\/p>\n<p>These typically use supervised&nbsp;training and single timeframe images. This method has shown promise, but its potential is constrained by the time-intensive process of manually labeling data.<\/p>\n<p><em>[Read:&nbsp;<a href=\"https:\/\/thenextweb.com\/distract\/2020\/12\/21\/how-netflix-shapes-mainstream-culture-explained-by-data\/\">How Netflix shapes mainstream culture, explained by data<\/a>]<\/em><\/p>\n<p>These limits led the researchers&nbsp;to use self-supervised learning instead.<\/p>\n<p>They first pre-trained their system on two public X-ray datasets, using a self-supervised learning technique called Momentum Contrast (MoCO). This allowed them to use a large quantity of non-COVID X-ray data to train their neural network to extract information from the images.<\/p>\n<h2>Predicting COVID-19 deterioration<\/h2>\n<p>They used the pre-trained model to build classifiers that predict if a COVID-19 patient\u2019s condition will likely worsen. They then fine-tuned the model with an extended version of the NYU COVID-19 dataset.<\/p>\n<p>This smaller dataset set of around&nbsp;<span class=\"s1\">27,000 X-ray images from 5,000 patients was given labels indicating whether the patient\u2018s condition deteriorated within 24, 48, 72, or 96 hours of the scan.<\/span><\/p>\n<p>The team built one classifier that predicts patient deterioration based on a single X-ray.&nbsp;Another makes its forecasts using a sequence of X-rays, by aggregating the image features through a Transformer model.&nbsp;A third model estimates how much supplemental oxygen patients might need by analyzing one X-ray.<\/p>\n<p>They say using a sequence of X-rays is particularly valuable, as they\u2019re more accurate for long-term predictions. This approach also accounts for the evolution of infections over time.<\/p>\n<p>Their study showed the models were effective at<span class=\"s1\">&nbsp;predicting ICU needs, mortality forecasts, and overall adverse event predictions in the longer-term (up to 96 hours):<\/span><\/p>\n<div class=\"page\" title=\"Page 11\">\n<div class=\"layoutArea\" readability=\"5.9570405727924\">\n<div class=\"column\" readability=\"9.6229116945107\">\n<blockquote readability=\"8\">\n<p><span>Our multi-image model performance surpassed that of all single-image models. In comparison to radiologists, our multi-image prediction model was comparable in its ability to predict patient deterioration and stronger in its ability to predict mortality.<\/span><\/p>\n<\/blockquote>\n<p>The team has <a href=\"https:\/\/github.com\/facebookresearch\/CovidPrognosis\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">open-sourced the pre-trained models<\/a> so that other researchers and hospitals can fine-tune them with their own COVID patient data \u2014 using a single GPU.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<p>You can read <a href=\"https:\/\/arxiv.org\/abs\/2101.04909\" target=\"_blank\" rel=\"nofollow noopener noreferrer\">the study paper<\/a>&nbsp;on the preprint server Axiv.org.<\/p>\n<p class=\"c-post-pubDate\"> Published January 15, 2021 \u2014 17:00 UTC <\/p>\n<p> <a href=\"https:\/\/thenextweb.com\/neural\/2021\/01\/15\/new-self-supervised-ai-models-scan-x-rays-to-predict-prognosis-of-covid-19-patients\/\">Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Researchers from Facebook and NYU Langone Health have created AI models that scan X-rays to predict&nbsp;how a COVID-19 patient\u2019s condition will develop. The team&nbsp;says that their system can forecast whether a patient&nbsp;may&#8230;<\/p>\n","protected":false},"author":1,"featured_media":2333,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/2332"}],"collection":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=2332"}],"version-history":[{"count":0,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/2332\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/media\/2333"}],"wp:attachment":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=2332"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=2332"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=2332"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}