Liwaiwai Liwaiwai
  • /
  • Artificial Intelligence
  • Machine Learning
  • Robotics
  • Engineering
    • Architecture
    • Design
    • Software
    • Hybrid Cloud
    • Data
  • About
Liwaiwai Liwaiwai
  • /
  • Artificial Intelligence
  • Machine Learning
  • Robotics
  • Engineering
    • Architecture
    • Design
    • Software
    • Hybrid Cloud
    • Data
  • About
  • Artificial Intelligence
  • Data

Detecting And Responding To Incidents With Images

  • August 27, 2020
  • relay
Natural disasters images

When a natural disaster occurs, on-the-ground emergency response teams act quickly to make life-saving decisions. Reducing the response time in such situations is critical to reduce damage impact and save lives. Helpful efforts are being taken to reduce the burden, such as a damage assessment tool by UNDP, though few automated methods exist. In recent work, MIT is creating tools that can automatically analyze images.

At the upcoming European Conference on Computer Vision (ECCV) conference, researchers from MIT and QCRI are presenting a new computer vision model capable of detecting incidents in images posted on social media platforms, such as Twitter and Flickr. They are also releasing the Incidents Dataset, a collection of 446,684 images labeled with 43 different incidents, including earthquakes, floods, wildfires, and car accidents. The paper, code, and data is available at the project page with interactive demos.

“I’m excited for this dataset to enable further research in detecting incidents in images, and to ideally spur interest in the computer vision community in general,” says Ethan Weber, an author on the paper and MEng student working with Professor Antonio Torralba.

The team’s new dataset aims to fill a void in the field, where existing datasets are limited in both the number of images and the diversity of incident categories. The authors go on to explain how the dataset was created, how a model can be created to detect incidents in images, and how to filter for incidents in noisy social media data.

One experiment filters 40 million Flickr images to find incidents. Additional experiments filter images posted on Twitter during earthquakes, floods, and other natural disasters. For example, the team filtered natural disaster-related tweets into specific incidents in a process that was validated by correlating tweet frequency with databases provided by the National Oceanic and Atmospheric Administration (NOAA).

Read More  The Role Of Artificial Intelligence In Compliance And Cybersecurity For Startups

As interest in automated response grows, competitions have emerged to further increase efforts in this direction–though not necessarily restricted to using images. The National Institute of Standards of Technology (NIST) launched a competition to promote fast analysis of unstructured data streams (social media, surveillance feeds, audio, text). Furthermore, last year the Defense Innovation Unit (DIU) hosted a challenge to advance building damage assessment techniques in satellite imagery. Instead of having humans look at satellite images and label where damage occurred, computers can help with rapid analysis.

Weber says that both social media and satellite imagery are valuable forms of data to help with emergency response. Social media provides on-the-ground insights, while satellite imagery provides expansive insights, such as determining which areas are most affected by a wildfire. Realizing this interconnectedness, Weber and MIT alum Hassan Kane teamed up and participated in the DIU challenge. Their team placed on the leaderboard for damage assessment, and they presented their award-winning work in the AI for Earth Science workshop at the ICLR 2020 conference.

With computer vision showing promising signs in both on-the-ground and satellite imagery, the MIT and QCRI researchers are now working on next steps. Enabled by the new ECCV dataset, the researchers hope to go beyond detecting incidents in damage.

“Now that we have the data, we’re interested in localizing and quantifying damage,” says Weber. “We’re working with emergency-response organizations to stay focussed and create research with real-world benefits.”

The Incidents Dataset presented in the ECCV paper is an effort by many contributors, including Weber, Nuria Marzo, Dim Papadopoulos, Aritro Biswas, Agata Lapedriza, Ferda Ofli, Muhammad Imran, and Antonio Torralba. More details on the study can be found on the project site.

Read More  Improving Model Quality At Scale With Vertex AI Model Evaluation
relay

Related Topics
  • AI for Earth Science
  • CSAIL
  • Defense Innovation Unit
  • DIU
  • ECCV
  • European Conference on Computer Vision
  • Images
  • MIT
  • National Institute of Standards of Technology
  • NIST
  • QCRI
You May Also Like
View Post
  • Artificial Intelligence
  • Machine Learning

6 ways Google AI Is Helping You Sleep Better

  • March 21, 2023
View Post
  • Artificial Intelligence
  • Machine Learning

AI Could Make More Work For Us, Instead Of Simplifying Our Lives

  • March 21, 2023
View Post
  • Artificial Intelligence
  • Platforms

Microsoft To Showcase Purpose-Built AI Infrastructure At NVIDIA GTC

  • March 21, 2023
View Post
  • Artificial Intelligence
  • Engineering
  • Tools

The Next Generation Of AI For Developers And Google Workspace

  • March 21, 2023
View Post
  • Data
  • Design
  • Engineering
  • Tools

Sumitovant More Than Doubles Its Research Output In Its Quest To Save Lives

  • March 21, 2023
View Post
  • Data
  • Platforms
  • Technology

How Osmo Is Digitizing Smell With Google Cloud AI Technology

  • March 20, 2023
View Post
  • Data
  • Engineering
  • Tools

Built With BigQuery: How Sift Delivers Fraud Detection Workflow Backtesting At Scale

  • March 20, 2023
View Post
  • Data

Understand And Trust Data With Dataplex Data Lineage

  • March 17, 2023

Leave a Reply

Your email address will not be published. Required fields are marked *

Stay Connected!
LATEST
  • 1
    6 ways Google AI Is Helping You Sleep Better
    • March 21, 2023
  • 2
    AI Could Make More Work For Us, Instead Of Simplifying Our Lives
    • March 21, 2023
  • 3
    Microsoft To Showcase Purpose-Built AI Infrastructure At NVIDIA GTC
    • March 21, 2023
  • 4
    The Next Generation Of AI For Developers And Google Workspace
    • March 21, 2023
  • 5
    Sumitovant More Than Doubles Its Research Output In Its Quest To Save Lives
    • March 21, 2023
  • 6
    How Osmo Is Digitizing Smell With Google Cloud AI Technology
    • March 20, 2023
  • 7
    Built With BigQuery: How Sift Delivers Fraud Detection Workflow Backtesting At Scale
    • March 20, 2023
  • 8
    Building The Most Open And Innovative AI Ecosystem
    • March 20, 2023
  • 9
    Understand And Trust Data With Dataplex Data Lineage
    • March 17, 2023
  • 10
    Limits To Computing: A Computer Scientist Explains Why Even In The Age Of AI, Some Problems Are Just Too Difficult
    • March 17, 2023

about
About
Hello World!

We are liwaiwai.com. Created by programmers for programmers.

Our site aims to provide materials, guides, programming how-tos, and resources relating to artificial intelligence, machine learning and the likes.

We would like to hear from you.

If you have any questions, enquiries or would like to sponsor content, kindly reach out to us at:

[email protected]

Live long & prosper!
Most Popular
  • 1
    The Benefits And Core Processes Of Data Wrangling
    • March 17, 2023
  • 2
    We Cannot Even Agree On Dates…
    • March 17, 2023
  • 3
    Financial Crisis: It’s A Game & We’re All Being Played
    • March 17, 2023
  • 4
    Using ML To Predict The Weather And Climate Risk
    • March 16, 2023
  • 5
    Google Is A Leader In The 2023 Gartner® Magic Quadrant™ For Enterprise Conversational AI Platforms
    • March 16, 2023
  • /
  • Artificial Intelligence
  • Machine Learning
  • Robotics
  • Engineering
  • About

Input your search keywords and press Enter.