GeForce RTX 3090 Ti and H100 CNX - video card comparison

GeForce RTX 3090 Ti

H100 CNX

Architecture

Ampere (2020−2022)

Hopper (2022)

GPU code name

Ampere GA102

GH100

Market segment

Desktop

Desktop

Release date

January 2022

March 2023

Interface

PCIe 4.0 x16

PCIe 5.0 x16

Supplementary power connectors

1x 16-pin

8-pin EPS

Boost clock speed

1860 MHz

1845 MHz

Core clock speed

1560 MHz

-

Manufacturing process technology

8 nm

4 nm

Number of transistors

28,300 million

80,000 million

Pipelines / CUDA cores

10752

14592

Power consumption (TDP)

450 Watt

350 Watt

Texture fill rate

625.0

841.3

Memory type

GDDR6X

HBM2e

Maximum RAM amount

24 GB

80 GB

Memory bus width

384 Bit

5120 Bit

Memory clock speed

21000 MHz

3.2 GB/s

Memory bandwidth

1,008 GB/s

2,039 GB/s

Shared memory

-

-

Display Connectors

1x HDMI 2.1, 3x DisplayPort 1.4a

No outputs

HDMI

+

-

DirectX

12 Ultimate (12_2)

N/A

CUDA

8.6

9.0

OpenCL

3.0

3.0

OpenGL

4.6

N/A

Shader Model

6.6

N/A

Vulkan

1.3

N/A