Nvidia H100 Tensor Core GPUs Come To Oracle Cloud

Robotic Hand | Lights

Oracle Cloud now offers bare-metal instances with Nvidia H100 GPUs for AI training and inference and high-performance computing applications. Nvidia L40S GPUs are on the way.

In response to growing demand for generative AI applications and large language models (LLM), Oracle Cloud Infrastructure (OCI) has made Nvidia H100 Tensor Core GPUs available on the OCI Compute platform. Nvidia L40S GPUs also will be coming to the platform soon.

Oracle said OCI Compute now offers bare-metal instances with Nvidia H100 GPUs, powered by the Nvidia Hopper architecture for AI, thus enabling an “order-of-magnitude performance leap” for large-scale AI and high-performance computing applications. The Nvidia H100 GPU is designed for resource-intensive computing tasks, including training LLM models.

Organizations using Nvidia H100 GPUs obtain as much as a 30x increase in AI inference performance and a 4x boost in AI training compared with tapping Nvidia A100 Tensor Core GPUs, Oracle said. The BM.GPU H100.8 OCI Compute shape includes eight Nvidia H100 GPUs, each with 80GB of HBM2 GPU memory.

OCI Compute bare-metal instances with Nvidia L40S GPUs will be available for early access later this year, with general availability early in 2024. Nvidia L40S GPUs, based on the Nvidia Ada Lovelace architecture for graphics, AI, and gaming, serve as a universal GPU for the data center, providing multi-workload acceleration for LLM inference and training, visual computing, and video applications.

By: Paul Krill (Editor at Large, InfoWorld)
Originally published at: InfoWorld

Source: cyberpogo.com

Read More  Supercharging IBM’s Cloud-Native AI Supercomputer

For enquiries, product placements, sponsorships, and collaborations, connect with us at [email protected]. We'd love to hear from you!

Read More


Introducing Apple Intelligence, the personal intelligence system that puts powerful generative models at the core of iPhone, iPad, and Mac

10 June 2024PRESS RELEASE Introducing Apple Intelligence, the personal intelligence system that puts powerful gener
Read More
tvOS 18 introduces intelligent new features like InSight that level up cinematic experiences. Users can stream Palm Royale on the Apple TV app with a subscription.

Updates to the Home experience elevate entertainment and bring more convenience 

10 June 2024 PRESS RELEASE tvOS 18 introduces new cinematic experiences with InSight, Enhance Dialogue, and subtitles CU
Read More