RTX A40 and H100 PCIe 80 GB - video card comparison
RTX A40
H100 PCIe 80 GB
Architecture
Ampere (2020−2022)
Hopper (2022)
GPU code name
GA102
GH100
Market segment
Desktop
Desktop
Release date
October 2020
March 2023
Interface
PCIe 4.0 x16
PCIe 5.0 x16
Supplementary power connectors
8-pin EPS
1x 16-pin
Boost clock speed
1755 MHz
1755 MHz
Manufacturing process technology
8 nm
4 nm
Number of transistors
28,300 million
80,000 million
Pipelines / CUDA cores
10752
14592
Power consumption (TDP)
300 Watt
350 Watt
Texture fill rate
589.7
800.3
Memory type
GDDR6
HBM2e
Maximum RAM amount
48 GB
80 GB
Memory bus width
384 Bit
5120 Bit
Memory clock speed
14.5 GB/s
3.2 GB/s
Memory bandwidth
695.8 GB/s
2,039 GB/s
Display Connectors
3x DisplayPort
No outputs
DirectX
12 Ultimate (12_2)
N/A
CUDA
8.6
9.0
OpenCL
2.0
3.0
OpenGL
4.6
N/A
Shader Model
6.5
N/A
Vulkan
1.2
N/A