Liwaiwai Liwaiwai
  • /
  • Artificial Intelligence
  • Machine Learning
  • Robotics
  • Engineering
    • Architecture
    • Design
    • Software
    • Hybrid Cloud
    • Data
  • About
  • /
  • Artificial Intelligence
  • Machine Learning
  • Robotics
  • Engineering
    • Architecture
    • Design
    • Software
    • Hybrid Cloud
    • Data
  • About
Liwaiwai Liwaiwai
  • /
  • Artificial Intelligence
  • Machine Learning
  • Robotics
  • Engineering
    • Architecture
    • Design
    • Software
    • Hybrid Cloud
    • Data
  • About
  • Artificial Intelligence
  • Machine Learning

MIT Researcher Explores The Downside Of Machine Learning In Healthcare

  • January 16, 2022
  • liwaiwai.com

While working toward her dissertation in Computer Science, Marzyeh Ghassemi PhD ’17 wrote some papers on how machine learning techniques from AI could be applied to clinical data in order to predict patient outcomes. “It wasn’t until the end of my PhD work that one of my committee members asked: ‘Did you ever check to see how well your model worked across different groups of people?’” That question was eye-opening for Ghassemi, who had previously assessed the performance of models in aggregate, across all patients. Upon a closer look, she saw that models often worked differently, specifically worse, for minorities like black women—a revelation that took her by surprise. “I hadn’t made the connection beforehand that health disparities would translate directly to model disparities,” she says. “And given that I am a visible minority woman-identifying computer scientist at MIT, I am reasonably certain that many others weren’t aware of this either.”

In a paper published on January 14 in the journal Patterns, Ghassemi—now an Assistant Professor in the Department of Electrical Engineering and Computer Science and IMES—and her coauthor, Elaine Okanyene Nsoesie of Boston University, offer a cautionary note about the prospects for AI in medicine. “If used carefully, this technology could improve performance in healthcare and potentially reduce inequities,” Ghassemi says. “But if we’re not actually careful, technology could worsen care.”


Partner with liwaiwai.com
for your next big idea.
Let us know here.


cyberpogo

It all comes down to data, given that the AI tools in question train themselves by processing and analyzing vast quantities of data. But the data they are given is produced by humans who are fallible and whose judgments may be clouded by the fact that they interact differently with patients depending on their age, gender, and race without even knowing it.

Read More  Space Has Arrived: Space Exploration Initiative At Ars Electronica 2020

Furthermore, there is still great uncertainty about medical conditions themselves. “Doctors trained at the same medical school for ten years can, and often do, disagree about a patient’s diagnosis,” Ghassemi says. That’s different from the applications where existing machine learning algorithms excel—like object recognition tasks—because practically everyone in the world will agree that a dog is, in fact, a dog.

Machine learning algorithms have also fared well in mastering games like chess and Go, where the both rules and “win conditions” are clearly defined. Physicians, however, don’t always concur on the rules for treating patients, and even the win condition of being “healthy” is not widely agreed upon. “Doctors know what it means to be sick,” Ghassemi explains, “and we have the most data for people when they are sickest. But we don’t get much data from people when they are healthy because they’re less likely to see doctors then.”

Surprisingly, even mechanical devices can contribute to flawed data and disparities in treatment. Pulse oximeters, for example, which have been calibrated predominately on light-skinned individuals, do not accurately measure blood oxygen levels for people with darker skin. And these deficiencies are most acute when oxygen levels are low—precisely when accurate readings are most urgent. Similarly, women face increased risks during “metal-on-metal” hip replacements, Ghassemi and Nsoesie write, “due in part to anatomic differences that aren’t taken into account in implant design.” Facts like these could be buried within the data fed to computer models whose output will be undermined as a result.

Coming from computers, the product of machine learning algorithms offers “the sheen of objectivity,” according to Ghassemi. But that can be deceptive and dangerous, because it’s harder to ferret out the faulty data supplied en masse to a computer than it is to discount the recommendations of a single possibly inept (and maybe even racist) doctor. “The problem is not machine learning itself,” she insists. “It’s people. Human care-givers generate bad data sometimes because they are not perfect.”

Read More  How Many Jobs Do Robots Really Replace?

Nevertheless, she still believes that machine learning can offer benefits in healthcare in terms of more efficient and fairer recommendations and practices. One key to realizing the promise of machine learning in healthcare is to improve the quality of data, which is no easy task. “Imagine if we could take data from doctors that have the best performance and share that with other doctors that have less training and experience,” Ghassemi says. “We really need to collect this data and audit it.”

The challenge here is that the collection of data is not incentivized or rewarded, she notes. “It’s not easy to get a grant for that, or ask students to spend time on it. And data providers might say, ‘Why should I give my data out for free when I can sell it to a company for millions?’ But researchers should be able to access data without having to deal with questions like: ‘What paper will I get my name on in exchange for giving you access to data that sits at my institution?’

“The only way to get better healthcare is to get better data,” Ghassemi says, “and the only way to get better data is to incentivize its release.”

It’s not only a question of collecting data. There’s also the matter of who will collect it and vet it. Ghassemi recommends assembling diverse groups of researchers—clinicians, statisticians, medical ethicists, and computer scientists—to first gather diverse patient data and then “focus on developing fair and equitable improvements in healthcare that can be deployed in not just one advanced medical setting, but in a wide range of medical settings.”

Read More  The Autonomous Killing Systems Of The Future Are Already Here, They’re Just Not Necessarily Weapons – Yet

The objective of the Patterns paper is not to discourage technologists from bringing their expertise in machine learning to the medical world, she says. “They just need to be cognizant of the gaps that appear in treatment and other complexities that ought to be considered before giving their stamp of approval to a particular computer model.”

 

By Steve Nadis
Source MIT


Our humans need coffee too! Your support is highly appreciated, thank you!

liwaiwai.com

Related Topics
  • Healthcare
  • MIT
  • Patterns
You May Also Like
Data | Points | Binary
View Post
  • Data
  • Machine Learning

Microsoft Offers Azure ML Data Import CLI, SDK For Snowflake, Other Databases

  • June 9, 2023
Classification | Binder
View Post
  • Data
  • Machine Learning

Build An Image Data Classification Model With BigQuery ML

  • June 9, 2023
View Post
  • Artificial Intelligence
  • Data Science
  • Machine Learning

H.I. To Gaia. Connecting Hyperintelligence With The Earth.

  • June 8, 2023
View Post
  • Artificial Intelligence
  • Automation
  • Data
  • Machine Learning
  • Technology

Why Are Humans Afraid Of AI?

  • June 8, 2023
View Post
  • Artificial Intelligence
  • Automation
  • Data
  • Research
  • Robotics
  • Technology

The Geography Of Artificial Intelligence

  • June 8, 2023
View Post
  • Artificial Intelligence
  • Automation
  • Data Science
  • Environment
  • Technology

Nature Already Inspired A.I. Than Most Realise

  • June 8, 2023
View Post
  • Artificial Intelligence
  • Technology

“A Field Guide To AI: For Business, Institutions, Society & Political Economy” — Your Essential Companion In Navigating the World of Artificial Intelligence.

  • June 7, 2023
View Post
  • Artificial Intelligence
  • Insights
  • People
  • Research
  • Science
  • Technology

Predictions: Top 25 Careers Likely In High Demand In The Future

  • June 6, 2023
Stay Connected!
LATEST
  • Data | Points | Binary 1
    Microsoft Offers Azure ML Data Import CLI, SDK For Snowflake, Other Databases
    • June 9, 2023
  • Classification | Binder 2
    Build An Image Data Classification Model With BigQuery ML
    • June 9, 2023
  • 3
    H.I. To Gaia. Connecting Hyperintelligence With The Earth.
    • June 8, 2023
  • 4
    Why Are Humans Afraid Of AI?
    • June 8, 2023
  • 5
    The Geography Of Artificial Intelligence
    • June 8, 2023
  • 6
    Nature Already Inspired A.I. Than Most Realise
    • June 8, 2023
  • 7
    “A Field Guide To AI: For Business, Institutions, Society & Political Economy” — Your Essential Companion In Navigating the World of Artificial Intelligence.
    • June 7, 2023
  • 8
    Predictions: Top 25 Careers Likely In High Demand In The Future
    • June 6, 2023
  • 9
    A S.W.O.T. Analysis Of Current A.I. Systems
    • June 6, 2023
  • Apple-WWCD23-Vision-Pro-glass-230605 10
    Introducing Apple Vision Pro: Apple’s first spatial computer
    • June 6, 2023

about
About
Hello World!

We are liwaiwai.com. Created by programmers for programmers.

Our site aims to provide materials, guides, programming how-tos, and resources relating to artificial intelligence, machine learning and the likes.

We would like to hear from you.

If you have any questions, enquiries or would like to sponsor content, kindly reach out to us at:

[email protected]

Live long & prosper!
Most Popular
  • 1
    Apple Unveils New Mac Studio And Brings Apple Silicon To Mac Pro
    • June 5, 2023
  • 2
    Apple Introduces M2 Ultra
    • June 5, 2023
  • 3
    tvOS 17 Brings FaceTime And Video Conferencing To The Biggest Screen In The Home
    • June 5, 2023
  • 4
    Apple Introduces The 15‑Inch MacBook Air
    • June 5, 2023
  • 5
    CrowdStrike Introduces Charlotte AI To Deliver Generative AI-Powered Cybersecurity
    • May 30, 2023
  • /
  • Artificial Intelligence
  • Explore
  • About
  • Contact Us

Input your search keywords and press Enter.