H100 SXM5 96 GB and Data Center GPU Max Subsystem - video card comparison

H100 SXM5 96 GB

Data Center GPU Max Subsystem

Architecture

Hopper (2022)

Generation 12.5 (2021−2022)

GPU code name

GH100

Ponte Vecchio

Market segment

Desktop

Release date

March 2023

January 2023

Interface

PCIe 5.0 x16

Supplementary power connectors

8-pin EPS

1x 16-pin

Boost clock speed

1837 MHz

1600 MHz

Manufacturing process technology

4 nm

10 nm

Number of transistors

80,000 million

100,000 million

Pipelines / CUDA cores

16896

16384

Power consumption (TDP)

700 Watt

2400 Watt

Texture fill rate

969.9

1,638

Memory type

HBM3

HBM2e

Maximum RAM amount

96 GB

128 GB

Memory bus width

5120 Bit

8192 Bit

Memory clock speed

2.6 GB/s

3.1 GB/s

Memory bandwidth

1,681 GB/s

3,205 GB/s

Display Connectors

No outputs

DirectX

N/A

12 (12_1)

CUDA

9.0

OpenCL

3.0

OpenGL

N/A

4.6

Shader Model

N/A

6.6

Vulkan

N/A