Liwaiwai Liwaiwai
  • /
  • Artificial Intelligence
  • Machine Learning
  • Robotics
  • Engineering
    • Architecture
    • Design
    • Software
    • Hybrid Cloud
    • Data
  • About
  • /
  • Artificial Intelligence
  • Machine Learning
  • Robotics
  • Engineering
    • Architecture
    • Design
    • Software
    • Hybrid Cloud
    • Data
  • About
Liwaiwai Liwaiwai
  • /
  • Artificial Intelligence
  • Machine Learning
  • Robotics
  • Engineering
    • Architecture
    • Design
    • Software
    • Hybrid Cloud
    • Data
  • About
  • Artificial Intelligence
  • Software Engineering
  • Technology

Intel Contributes AI Acceleration to PyTorch 2.0

  • March 15, 2023
  • liwaiwai.com

New features for AI developers in research and production environments optimize performance.

In the release of Python 2.0, contributions from Intel using Intel® Extension for PyTorch , oneAPI Deep Neural Network Library (oneDNN) and additional support for Intel® CPUs enable developers to optimize inference and training performance for artificial intelligence (AI).


Partner with liwaiwai.com
for your next big idea.
Let us know here.


cyberpogo

As part of the PyTorch 2.0 compilation stack, the TorchInductor CPU backend optimization by Intel Extension for PyTorch and PyTorch ATen CPU achieved up to 1.7 times faster FP32 inference performance when benchmarked with TorchBench, HuggingFace and timm.1 This update brings notable performance improvements to graph compilation over the PyTorch eager mode.

Other optimizations include:

  • Improved message-passing between adjacent neural network nodes to support graph neural network in PyTorch Geometric (PyG) for enhanced inference and performance training on Intel CPUs.
  • New x86 quantization backend – a combination of FBGEMM (Facebook General Matrix-Matrix Multiplication) and oneDNN backends – replaces FBGEMM as the default quantization backend for x86 CPU platforms to enable better end-to-end int8 inference performance. 
  • Extended use of oneDNN with oneDNN Graph API to maximize efficient code generation on AI hardware by automatically identifying the graph partitions to be accelerated through fusion. BFloat16 and Float32 data types are supported and only inference workloads can be optimized; BF16 is only optimized on machines with AVX512_BF16 ISA support.  

More: Read the full announcement blog “Celebrate PyTorch* 2.0 with New Performance Features for AI Developers.”

1See https://github.com/pytorch/pytorch/issues/93531#issuecomment-1457373890, Performance Dashboard for float32 precision – single-socket multi-threads (2023-03-05 nightly release).

Source: Cyberpogo

Read More  CES: Udelv Unveils Mobileye-Powered AV Transporter

Our humans need coffee too! Your support is highly appreciated, thank you!

liwaiwai.com

Related Topics
  • AI
  • Artificial Intelligence
  • Intel
  • Python
  • PyTorch
You May Also Like
View Post
  • Artificial Intelligence
  • Software Engineering

When The Rubber Duck Talks Back

  • June 1, 2023
View Post
  • Artificial Intelligence
  • Technology

Helping Robots Handle Fluids

  • June 1, 2023
View Post
  • Artificial Intelligence

Introducing 100K Context Windows

  • May 30, 2023
View Post
  • Architecture
  • Artificial Intelligence
  • Design

Sandvik unveils the Impossible Statue – an AI-enabled collaboration between Michelangelo, Rodin, Kollwitz, Kotaro, Savage and Sandvik

  • May 30, 2023
View Post
  • Artificial Intelligence
  • Technology

Capgemini And Google Cloud Expand Long-Standing Partnership To Create First-Of-Its Kind Generative AI Center Of Excellence To Accelerate Client Value

  • May 30, 2023
View Post
  • Artificial Intelligence

How Auditoria.AI Is Building AI-Powered Smart Assistants For Finance Teams

  • May 29, 2023
View Post
  • Artificial Intelligence
  • Technology

AI Coming To The PC At Scale

  • May 27, 2023
View Post
  • Artificial Intelligence
  • Platforms

Build Next-Generation, AI-Powered Applications On Microsoft Azure

  • May 26, 2023
Stay Connected!
LATEST
  • 1
    When The Rubber Duck Talks Back
    • June 1, 2023
  • 2
    Helping Robots Handle Fluids
    • June 1, 2023
  • 3
    Introducing 100K Context Windows
    • May 30, 2023
  • 4
    Sandvik unveils the Impossible Statue – an AI-enabled collaboration between Michelangelo, Rodin, Kollwitz, Kotaro, Savage and Sandvik
    • May 30, 2023
  • 5
    Capgemini And Google Cloud Expand Long-Standing Partnership To Create First-Of-Its Kind Generative AI Center Of Excellence To Accelerate Client Value
    • May 30, 2023
  • 6
    Effective Management Of Data Sources In Machine Learning
    • May 29, 2023
  • 7
    How Auditoria.AI Is Building AI-Powered Smart Assistants For Finance Teams
    • May 29, 2023
  • 8
    G7 2023: The Real Threat To The World Order Is Hypocrisy.
    • May 28, 2023
  • 9
    AI Coming To The PC At Scale
    • May 27, 2023
  • 10
    Build Next-Generation, AI-Powered Applications On Microsoft Azure
    • May 26, 2023

about
About
Hello World!

We are liwaiwai.com. Created by programmers for programmers.

Our site aims to provide materials, guides, programming how-tos, and resources relating to artificial intelligence, machine learning and the likes.

We would like to hear from you.

If you have any questions, enquiries or would like to sponsor content, kindly reach out to us at:

[email protected]

Live long & prosper!
Most Popular
  • 1
    Combining Generative AI With IBM Watson, Mitsui Chemicals Starts Verifying New Application Discovery For Agility And Accuracy
    • May 25, 2023
  • 2
    Wipro Expands Google Cloud Partnership To Advance Enterprise Adoption Of Generative AI
    • May 23, 2023
  • 3
    Google Cloud Launches AI-Powered Solutions To Safely Accelerate Drug Discovery And Precision Medicine
    • May 16, 2023
  • 4
    Huawei And Partners Announce Yucatan Wildlife Conservation Findings
    • May 18, 2023
  • 5
    Cloudflare’s R2 Is The Infrastructure Powering Leading AI Companies
    • May 16, 2023
  • /
  • Artificial Intelligence
  • Explore
  • About
  • Contact Us

Input your search keywords and press Enter.