Liwaiwai Liwaiwai
  • /
  • Artificial Intelligence
  • Machine Learning
  • Robotics
  • Engineering
    • Architecture
    • Design
    • Software
    • Hybrid Cloud
    • Data
  • About
Liwaiwai Liwaiwai
  • /
  • Artificial Intelligence
  • Machine Learning
  • Robotics
  • Engineering
    • Architecture
    • Design
    • Software
    • Hybrid Cloud
    • Data
  • About
  • Artificial Intelligence
  • Machine Learning

Amplifying Security Of Quantized Neural Networks

  • May 29, 2019
  • admin

A common industry standard for deep learning hardware is the use of neural network quantization, as noted by an MIT study. Neural networks are computation and memory intensive. Quantization cuts down on the usage of these resources by stripping an input of details which won’t gravely affect the information conveyed.

As an example, consider image quantization. Creating GIFs involves compressing photographs containing potentially thousands of colors to an image with a maximum of 256 colors. While there’s just a limited number of colors, humans can still discern what is being conveyed by the original image. With less information to contain, a GIF file occupies less memory space. Moreover, it is easier to send over networks. This makes it suitable for instant messaging.

Neural network quantization can also be used to automate tasks such as driving. By compressing the signals received by an deep learning machine, quick and accurate decisions can be made on the whim.

The catch

The problem is, standard quantization procedures are vulnerable to adversarial attacks. Adversarial attacks are slight disturbances indiscernible to humans. For deep learning models however, it can cause confusion. This leads to incorrect responses. Needless to say, this is  an alarming security threat since it could be easily taken advantage by attackers to disrupt the models, potentially endangering users.

To make things worse, increase in layers of processing translates to error amplification. Now we see that there must be a balance between attaining efficiency and maintaining robustness.If we are headed towards a future which heavily relies on the faculties of deep learning models, we ought to solve this matter.

Read More  Google I/O 2019 | Live Coding A Machine Learning Model from Scratch

The fix

In the earlier mentioned MIT study authored by Ji Lin, Chuang Gan, and Song Han, a possible solution is presented. This comes in the form of the introduction of a mathematical constraint known as the Lipschitz constraint during quantization to keep the error amplification at bay. Their study reveals that the control over the Lipschitz constraint results to performance gains.

The researchers intend to expand the application of this technique to larger data sets and a wider range of models.

“Deep learning models need to be fast and secure as they move into a world of internet-connected devices,” Gan remarked in an interview.

Truly enough, resolving this matter will open doors to a technology which will make our lives simultaneously easier and secure.

admin

Related Topics
  • Adversarial Attack
  • Deep Learning
  • Neural Network
You May Also Like
View Post
  • Artificial Intelligence
  • Software
  • Technology

Bard And ChatGPT — A Head To Head Comparison

  • March 31, 2023
View Post
  • Artificial Intelligence
  • Platforms

Modernize Your Apps And Accelerate Business Growth With AI

  • March 31, 2023
View Post
  • Artificial Intelligence
  • Technology

Unlocking The Secrets Of ChatGPT: Tips And Tricks For Optimizing Your AI Prompts

  • March 29, 2023
View Post
  • Artificial Intelligence
  • Technology

Try Bard And Share Your Feedback

  • March 29, 2023
View Post
  • Artificial Intelligence
  • Data
  • Data Science
  • Machine Learning
  • Technology

Google Data Cloud & AI Summit : In Less Than 12 Hours From Now

  • March 29, 2023
View Post
  • Artificial Intelligence
  • Technology

Talking Cars: The Role Of Conversational AI In Shaping The Future Of Automobiles

  • March 28, 2023
View Post
  • Artificial Intelligence
  • Tools

Document AI Introduces Powerful New Custom Document Classifier To Automate Document Processing

  • March 28, 2023
View Post
  • Artificial Intelligence
  • Design
  • Practices

How AI Can Improve Digital Security

  • March 27, 2023

Leave a Reply

Your email address will not be published. Required fields are marked *

Stay Connected!
LATEST
  • 1
    Bard And ChatGPT — A Head To Head Comparison
    • March 31, 2023
  • 2
    Modernize Your Apps And Accelerate Business Growth With AI
    • March 31, 2023
  • 3
    Why Your Open Source Project Needs A Content Strategy
    • March 31, 2023
  • 4
    From Raw Data To Actionable Insights: The Power Of Data Aggregation
    • March 30, 2023
  • 5
    Effective Strategies To Closing The Data-Value Gap
    • March 30, 2023
  • 6
    Unlocking The Secrets Of ChatGPT: Tips And Tricks For Optimizing Your AI Prompts
    • March 29, 2023
  • 7
    Try Bard And Share Your Feedback
    • March 29, 2023
  • 8
    Google Data Cloud & AI Summit : In Less Than 12 Hours From Now
    • March 29, 2023
  • 9
    Talking Cars: The Role Of Conversational AI In Shaping The Future Of Automobiles
    • March 28, 2023
  • 10
    Document AI Introduces Powerful New Custom Document Classifier To Automate Document Processing
    • March 28, 2023

about
About
Hello World!

We are liwaiwai.com. Created by programmers for programmers.

Our site aims to provide materials, guides, programming how-tos, and resources relating to artificial intelligence, machine learning and the likes.

We would like to hear from you.

If you have any questions, enquiries or would like to sponsor content, kindly reach out to us at:

[email protected]

Live long & prosper!
Most Popular
  • 1
    Introducing GPT-4 in Azure OpenAI Service
    • March 21, 2023
  • 2
    How AI Can Improve Digital Security
    • March 27, 2023
  • 3
    ChatGPT 4.0 Finally Gets A Joke
    • March 27, 2023
  • 4
    Mr. Cooper Is Improving The Home-buyer Experience With AI And ML
    • March 24, 2023
  • 5
    My First Pull Request At Age 14
    • March 24, 2023
  • /
  • Artificial Intelligence
  • Machine Learning
  • Robotics
  • Engineering
  • About

Input your search keywords and press Enter.