Liwaiwai Liwaiwai
  • /
  • Artificial Intelligence
  • Machine Learning
  • Robotics
  • Engineering
    • Architecture
    • Design
    • Software
    • Hybrid Cloud
    • Data
  • About
Liwaiwai Liwaiwai
  • /
  • Artificial Intelligence
  • Machine Learning
  • Robotics
  • Engineering
    • Architecture
    • Design
    • Software
    • Hybrid Cloud
    • Data
  • About
  • Artificial Intelligence

New AI Research To Help Predict COVID-19 Resource Needs From A Series Of X-rays

  • January 18, 2021
  • relay

Researchers, healthcare providers, and many others around the world are still grappling with COVID-19. Even a year into the pandemic, it remains challenging for doctors to predict how a patient’s condition may change over the course of the disease. Will the patient improve in the next few days or worsen to the point where more intensive care is needed? With resources under unprecedented strain, it’s important that hospitals know whether patients are likely to need escalated treatment and plan accordingly.

As part of our ongoing collaboration with NYU Langone Health’s Predictive Analytics Unit and Department of Radiology, we have developed three machine learning (ML) models that could help doctors predict how a patient’s condition may develop, in order to help hospitals ensure they have sufficient resources to care for patients: 1) a model for predicting patient deterioration based on a single X-ray, 2) a model for predicting patient deterioration based on a sequence of X-rays, and 3) a model for predicting how much supplemental oxygen (if any) a patient might need based on a single X-ray.

Our model using sequential chest X-rays can predict up to four days (96 hours) in advance if a patient may need more intensive care solutions, generally outperforming predictions by human experts. These predictions could help doctors avoid sending at-risk patients home too soon, and help hospitals better predict demand for supplemental oxygen and other limited resources.

We are open-sourcing our pretrained models and publishing our research so the broader community can benefit from and build on what we’ve done.

 

Leveraging self-supervised learning

Previous approaches to this problem have relied on supervised training and used single timeframe images. While progress has been made with supervised training methods, labeling data is extremely time-intensive and thus limiting. We chose instead to pretrain our ML system on two large, public chest X-ray data sets, MIMIC-CXR-JPG and CheXpert, using a self-supervised learning technique called Momentum Contrast (MoCo). This allowed us to use large amounts of non-COVID chest X-ray data to train a neural network that could extract information from chest X-ray images. Then we fine-tuned the MoCo model using an extended version of the NYU COVID-19 data set.

Read More  5 Charts That Show What People Around The World Think About AI

MoCo relies on unsupervised learning using a contrastive loss function, mapping images to a latent space wherein similar images are mapped to vectors that are close together and dissimilar images to vectors that are further apart. These vectors can be used as feature representations, allowing one to train classifiers using a small number of labeled examples. Recent research shows that self-supervised learning using contrastive loss functions is effective in a variety of classification tasks.

After pretraining the MoCo model on MIMIC-CXR-JPG and CheXpert, we then used the pretrained model to build classifiers that could predict whether a COVID-19 patient’s condition is likely to deteriorate. As mentioned, we used the NYU COVID chest X-ray data set for fine-tuning, as it contained 26,838 X-ray images taken from 4,914 patients. This smaller data set was labeled with whether the patient’s condition worsened within 24, 48, 72, or 96 hours of the scan in question.

We built two kinds of classifiers to predict patient deterioration. The first model predicts patient deterioration based on a single X-ray in a fashion similar to a previous study. The second model predicts patient deterioration based on a sequence of X-rays by aggregating the image features via a Transformer model.

 

Helping with resource planning

Using self-supervised learning without having to rely on labeled data sets is crucial, as few research groups have enough COVID chest X-rays to train AI models. Building AI models that can use a sequence of X-rays for prediction purposes is particularly valuable because this method mirrors how human radiologists work, as using a sequence of X-rays is more accurate for long-term predictions. Importantly, this method also accounts for the evolution of COVID infections over time.

Read More  Can AI-based Cybersecurity Render Human Error Extinct?

Based on reader studies that we conducted with radiologists at NYU Langone, our models that used sequences of X-ray images outperformed human experts at predicting ICU needs and mortality predictions, and overall adverse event predictions in the longer term (up to 96 hours). Being able to predict whether a patient will need oxygen resources would also be a first, and could help hospitals as they decide how to allocate resources in the weeks and months to come. With COVID-19 cases rising again across the world, hospitals need tools to predict and prepare for upcoming surges as they plan their resource allocations. Our models could help.

“We have been able to show that with the use of this AI algorithm, serial chest radiographs can predict the need for escalation of care in patients with COVID-19,” says William Moore, MD, a Professor of Radiology at NYU Langone Health. “As COVID-19 continues to be a major public health issue, the ability to predict a patient’s need for elevation of care — for example, ICU admission — will be essential for hospitals.”

These models are not products, but rather research solutions, intended to help hospitals in the days and months to come with resource planning. While hospitals have their own unique data sets, they often don’t have the computational power necessary to train deep learning models from scratch. We are open-sourcing our pretrained models (and publishing our results) so that hospitals with limited computational resources can fine-tune the models using their own data — work that can be done with a single GPU.

Read More  Inaugural AI Research Grants Advance Transformational Projects In Education, Health Care And Government

Both NYU Langone Health and Facebook AI remain committed to the principles of open science, and hope that by releasing this research, hospitals and the community at large can build upon what we’ve done so far — and that our models help the experts make crucial decisions and better serve patients with their limited time and resources.

By Anuroop Sriram Research Engineer |  Matthew Muckley Research Engineer | Koustuv Sinha Research Assistant | Nafissa Yakubova Program Manager
Source Facebook AI

relay

Related Topics
  • COVID-19
  • Facebook AI
  • NYU Langone
  • Research
  • X-ray
You May Also Like
View Post
  • Artificial Intelligence
  • Software
  • Technology

Bard And ChatGPT — A Head To Head Comparison

  • March 31, 2023
View Post
  • Artificial Intelligence
  • Platforms

Modernize Your Apps And Accelerate Business Growth With AI

  • March 31, 2023
View Post
  • Artificial Intelligence
  • Technology

Unlocking The Secrets Of ChatGPT: Tips And Tricks For Optimizing Your AI Prompts

  • March 29, 2023
View Post
  • Artificial Intelligence
  • Technology

Try Bard And Share Your Feedback

  • March 29, 2023
View Post
  • Artificial Intelligence
  • Data
  • Data Science
  • Machine Learning
  • Technology

Google Data Cloud & AI Summit : In Less Than 12 Hours From Now

  • March 29, 2023
View Post
  • Artificial Intelligence
  • Technology

Talking Cars: The Role Of Conversational AI In Shaping The Future Of Automobiles

  • March 28, 2023
View Post
  • Artificial Intelligence
  • Tools

Document AI Introduces Powerful New Custom Document Classifier To Automate Document Processing

  • March 28, 2023
View Post
  • Artificial Intelligence
  • Design
  • Practices

How AI Can Improve Digital Security

  • March 27, 2023

Leave a Reply

Your email address will not be published. Required fields are marked *

Stay Connected!
LATEST
  • 1
    DBS Singapore: The Best Boasting To Be The Best For So Long, Humbled By Hubris
    • March 31, 2023
  • 2
    Bard And ChatGPT — A Head To Head Comparison
    • March 31, 2023
  • 3
    Modernize Your Apps And Accelerate Business Growth With AI
    • March 31, 2023
  • 4
    Why Your Open Source Project Needs A Content Strategy
    • March 31, 2023
  • 5
    From Raw Data To Actionable Insights: The Power Of Data Aggregation
    • March 30, 2023
  • 6
    Effective Strategies To Closing The Data-Value Gap
    • March 30, 2023
  • 7
    Unlocking The Secrets Of ChatGPT: Tips And Tricks For Optimizing Your AI Prompts
    • March 29, 2023
  • 8
    Try Bard And Share Your Feedback
    • March 29, 2023
  • 9
    Google Data Cloud & AI Summit : In Less Than 12 Hours From Now
    • March 29, 2023
  • 10
    Talking Cars: The Role Of Conversational AI In Shaping The Future Of Automobiles
    • March 28, 2023

about
About
Hello World!

We are liwaiwai.com. Created by programmers for programmers.

Our site aims to provide materials, guides, programming how-tos, and resources relating to artificial intelligence, machine learning and the likes.

We would like to hear from you.

If you have any questions, enquiries or would like to sponsor content, kindly reach out to us at:

[email protected]

Live long & prosper!
Most Popular
  • 1
    Introducing GPT-4 in Azure OpenAI Service
    • March 21, 2023
  • 2
    Document AI Introduces Powerful New Custom Document Classifier To Automate Document Processing
    • March 28, 2023
  • 3
    How AI Can Improve Digital Security
    • March 27, 2023
  • 4
    ChatGPT 4.0 Finally Gets A Joke
    • March 27, 2023
  • 5
    Mr. Cooper Is Improving The Home-buyer Experience With AI And ML
    • March 24, 2023
  • /
  • Artificial Intelligence
  • Machine Learning
  • Robotics
  • Engineering
  • About

Input your search keywords and press Enter.