H100 SXM5 and GeForce RTX 4090 Ti - video card comparison

H100 SXM5

GeForce RTX 4090 Ti

Architecture

Hopper (2022)

Ada Lovelace

GPU code name

GH100

AD102

Market segment

Desktop

Release date

March 2022

2023

Interface

PCIe 5.0 x16

PCIe 4.0 x16

Supplementary power connectors

8-pin EPS

2x 16-pin

Boost clock speed

1780 MHz

2565 MHz

Manufacturing process technology

4 nm

5 nm

Number of transistors

80,000 million

76,300 million

Pipelines / CUDA cores

8448

18176

Power consumption (TDP)

700 Watt

600 Watt

Texture fill rate

939.8

1,457

Memory type

HBM3

GDDR6X

Maximum RAM amount

80 GB

24 GB

Memory bus width

5120 Bit

384 Bit

Memory clock speed

3 GB/s

24 GB/s

Memory bandwidth

1,920 GB/s

1,152 GB/s

Display Connectors

No outputs

1x HDMI 2.1, 3x DisplayPort 1.4a

HDMI

DirectX

N/A

12 Ultimate (12_2)

CUDA

9.0

8.9

OpenCL

3.0

OpenGL

N/A

4.6

Shader Model

N/A

6.7

Vulkan

N/A

1.3