H100 PCIe 96 GB and RTX A1000 - video card comparison

H100 PCIe 96 GB

RTX A1000

Architecture

Hopper (2022)

Ampere (2020−2022)

GPU code name

GH100

GA107

Market segment

Desktop

Desktop

Release date

March 2023

April 2024

Interface

PCIe 5.0 x16

PCIe 4.0 x8

Supplementary power connectors

8-pin EPS

None

Boost clock speed

1837 MHz

1462 MHz

Manufacturing process technology

4 nm

8 nm

Number of transistors

80,000 million

8,700 million

Pipelines / CUDA cores

16896

2304

Power consumption (TDP)

700 Watt

50 Watt

Texture fill rate

969.9

105.3

Memory type

HBM3

GDDR6

Maximum RAM amount

96 GB

8 GB

Memory bus width

5120 Bit

128 Bit

Memory clock speed

2.6 GB/s

12 GB/s

Memory bandwidth

1,681 GB/s

192.0 GB/s

Display Connectors

No outputs

4x mini-DisplayPort 1.4a

DirectX

N/A

12 Ultimate (12_2)

CUDA

9.0

8.6

OpenCL

3.0

3.0

OpenGL

N/A

4.6

Shader Model

N/A

6.7

Vulkan

N/A

1.3