GPU Details

Image of HGX H100

NVIDIA HGX H100

Product information

80 GB

Description

The data center is the new unit of computing, and networking plays an integral role in scaling application performance across it. Paired with NVIDIA Quantum InfiniBand, HGX delivers world-class performance and efficiency, which ensures the full utilization of computing resources.

For AI cloud data centers that deploy Ethernet, HGX is best used with the NVIDIA Spectrum-X networking platform, which powers the highest AI performance over 400Gb/s Ethernet. Featuring NVIDIA Spectrum™-4 switches and BlueField-3 DPUs, Spectrum-X delivers consistent, predictable outcomes for thousands of simultaneous AI jobs at every scale through optimal resource utilization and performance isolation. Spectrum-X enables advanced cloud multi-tenancy and zero-trust security.  As a reference design for NVIDIA Spectrum-X, NVIDIA has designed Israel-1, a hyperscale generative AI supercomputer built with Dell PowerEdge XE9680 servers based on the NVIDIA HGX H200 or H100 eight-GPU platform, BlueField-3 DPUs, and Spectrum-4 switches.

Additional details

  • Gpu name: HGX H100
  • Ram: 80 GB
  • Manufacturer: NVIDIA
ProviderGPUNumber of GPUsVCPURAMPrice $/hour
Cloud ProviderGPUNumber of GPUsRAMStorageNetworkCluster InterfacePrice $/GPU/hour

Inferences

A list of all the inferences available.

ProviderGPU FlavorvCPURAMPre-charged modelsPriceRent