A40 PCIe and H100 SXM5 - video card comparison

A40 PCIe

H100 SXM5

Architecture

Ampere (2020−2022)

Hopper (2022)

GPU code name

GA102

GH100

Market segment

Desktop

Desktop

Release date

October 2020

March 2022

Interface

PCIe 4.0 x16

PCIe 5.0 x16

Supplementary power connectors

8-pin EPS

8-pin EPS

Boost clock speed

1755 MHz

1780 MHz

Manufacturing process technology

8 nm

4 nm

Number of transistors

28,300 million

80,000 million

Pipelines / CUDA cores

10752

8448

Power consumption (TDP)

300 Watt

700 Watt

Texture fill rate

589.7

939.8

Memory type

GDDR6

HBM3

Maximum RAM amount

48 GB

80 GB

Memory bus width

384 Bit

5120 Bit

Memory clock speed

14.5 GB/s

3 GB/s

Memory bandwidth

695.8 GB/s

1,920 GB/s

Display Connectors

3x DisplayPort

No outputs

DirectX

12 Ultimate (12_2)

N/A

CUDA

8.6

9.0

OpenCL

2.0

3.0

OpenGL

4.6

N/A

Shader Model

6.5

N/A

Vulkan

1.2

N/A