RTX A4000 and H100 SXM5 80 GB - video card comparison

RTX A4000

H100 SXM5 80 GB

Architecture

Ampere (2020−2022)

Hopper (2022)

GPU code name

GA104

GH100

Market segment

Workstation

Desktop

Release date

April 2021

March 2023

Interface

PCIe 4.0 x16

PCIe 5.0 x16

Supplementary power connectors

1x 6-pin

None

Boost clock speed

1560 MHz

1980 MHz

Manufacturing process technology

8 nm

4 nm

Number of transistors

17,400 million

80,000 million

Pipelines / CUDA cores

6144

16896

Power consumption (TDP)

140 Watt

700 Watt

Texture fill rate

299.5

1,045

Memory type

GDDR6

HBM3

Maximum RAM amount

16 GB

80 GB

Memory bus width

256 Bit

5120 Bit

Memory clock speed

14 GB/s

2.6 GB/s

Memory bandwidth

448.0 GB/s

1,681 GB/s

Display Connectors

4x DisplayPort 1.4a

No outputs

DirectX

12 Ultimate (12_2)

N/A

CUDA

8.6

9.0

OpenCL

3.0

3.0

OpenGL

4.6

N/A

Shader Model

6.7

N/A

Vulkan

1.3

N/A