A100 PCIe and H100 SXM5 96 GB - video card comparison

A100 PCIe

H100 SXM5 96 GB

Architecture

Ampere (2020−2022)

Hopper (2022)

GPU code name

GA100

GH100

Market segment

Desktop

Desktop

Release date

June 2020

March 2023

Interface

PCIe 4.0 x16

PCIe 5.0 x16

Supplementary power connectors

1x 8-pin

8-pin EPS

Boost clock speed

-

1837 MHz

Core clock speed

1410 MHz

-

Manufacturing process technology

7 nm

4 nm

Number of transistors

54,200 million

80,000 million

Pipelines / CUDA cores

6912

16896

Power consumption (TDP)

250 Watt

700 Watt

Texture fill rate

609.1

969.9

Memory type

HBM2e

HBM3

Maximum RAM amount

40 GB

96 GB

Memory bus width

5120 Bit

5120 Bit

Memory clock speed

2.4 GB/s

2.6 GB/s

Memory bandwidth

1,555 GB/s

1,681 GB/s

Display Connectors

No outputs

No outputs

DirectX

12 Ultimate (12_2)

N/A

CUDA

8.0

9.0

OpenCL

2.0

3.0

OpenGL

4.6

N/A

Shader Model

6.5

N/A

Vulkan

1.2

N/A