NVIDIA Excessive-Efficiency Chips Energy AI Workloads

NVIDIA’s AI Enterprise software program proven at Supercomputing ‘23 connects accelerated computing to giant language mannequin use circumstances.

On the Supercomputing ‘23 convention in Denver on Nov. 13, NVIDIA introduced expanded availability of the NVIDIA GH200 Grace Hopper Superchip for high-performance computing and HGX H200 Techniques and Cloud Situations for AI coaching.

Leap to:

NVIDIA HGX GH200 supercomputer enhances generative AI and high-performance computing workloads

The HGX GH200 supercomputing platform, which is constructed on the NVIDIA H200 Tensor Core GPU, might be accessible via server producers and {hardware} suppliers which have partnered with NVIDIA. The HGX GH200 is anticipated to begin delivery from cloud suppliers and producers in Q2 2024.

Amazon Net Providers, Google Cloud, Microsoft Azure, CoreWeave, Lambda, Vultr and Oracle Cloud Infrastructure will provide H200-based situations in 2024.

NVIDIA HGX H200 options the next:

• NVIDIA H200 Tensor Core GPU for generative AI and high-performance computing workloads that require large quantities of reminiscence (141 GB of reminiscence at 4.8 terabytes per second).
• Doubling inference pace on Llama 2, a 70 billion-parameter LLM, in comparison with the NVIDIA H100.
• Interoperable with the NVIDIA GH200 Grace Hopper Superchip with HBM3e.
• Deployable in any sort of knowledge heart, together with on servers with present companions  ASRock Rack, ASUS, Dell Applied sciences, Eviden, GIGABYTE, Hewlett Packard Enterprise, Ingrasys, Lenovo, QCT, Supermicro, Wistron and Wiwynn.
• Can present inference and coaching for the biggest LLM fashions past 175 billion parameters.
• Over 32 petaflops of FP8 deep studying compute and 1.1TB of combination high-bandwidth reminiscence.

“To create intelligence with generative AI and HPC purposes, huge quantities of knowledge should be effectively processed at excessive pace utilizing giant, quick GPU reminiscence,” mentioned Ian Buck, vice chairman of hyperscale and HPC at NVIDIA, in a press launch.

NVIDIA’s GH200 chip is suited to supercomputing and AI coaching

NVIDIA will now provide HPE Cray EX2500 supercomputers with the GH200 chip (Determine A) for enhanced supercomputing and AI coaching. HPE introduced a supercomputing answer for generative AI made up in a part of NVIDIA’s HPE Cray EX2500 supercomputer configuration.

Determine A

The GH200 consists of Arm-based NVIDIA Grace CPU and Hopper GPU architectures utilizing NVIDIA NVLink-C2C interconnect know-how. The GH200 might be packaged inside programs from Dell Applied sciences, Eviden, Hewlett Packard Enterprise, Lenovo, QCT and Supermicro, NVIDIA introduced at Supercomputing ’23.

SEE: NVIDIA introduced AI training-as-a-service in July (TechRepublic)

“Organizations are quickly adopting generative AI to speed up enterprise transformations and technological breakthroughs,” mentioned Justin Hotard, government vice chairman and normal supervisor of HPC, AI and Labs at HPE, in a weblog put up. “Working with NVIDIA, we’re excited to ship a full supercomputing answer for generative AI, powered by applied sciences like Grace Hopper, which can make it straightforward for patrons to speed up large-scale AI mannequin coaching and tuning at new ranges of effectivity.”

What can the GH200 allow?

Tasks like HPE’s present that supercomputing has purposes for generative AI coaching, which might be utilized in enterprise computing. The GH200 interoperates with the NVIDIA AI Enterprise suite of software program for workloads resembling speech, recommender programs and hyperscale inference. It might be used together with an enterprise’s information to run giant language fashions educated on the enterprise’s information.

NVIDIA makes new supercomputing analysis heart partnerships

NVIDIA introduced partnerships with supercomputing facilities world wide. Germany’s Jülich Supercomputing Centre’s scientific supercomputer, JUPITER, will use GH200 superchips. JUPITER might be used to create AI basis fashions for local weather and climate analysis, materials science, drug discovery, industrial engineering and quantum computing for the scientific neighborhood. The Texas Superior Computing Middle’s Vista supercomputer and the College of Bristol’s upcoming Isambard-AI supercomputer will even use GH200 superchips.

Quite a lot of cloud suppliers provide GH200 entry

Cloud suppliers Lambda and Vultr provide NVIDIA GH200 in early entry now. Oracle Cloud Infrastructure and CoreWeave plan to supply NVIDIA GH200 situations sooner or later, beginning in Q1 2024 for CoreWeave; Oracle didn’t specify a date.