H100 SXM5 96 GB and GeForce RTX 4080 SUPER - video card comparison
H100 SXM5 96 GB
GeForce RTX 4080 SUPER
Architecture
Hopper (2022)
Ada Lovelace
GPU code name
GH100
AD103-400-A1
Market segment
Desktop
Desktop
Release date
March 2023
January 2024
Interface
PCIe 5.0 x16
PCIe 4.0 x16
Supplementary power connectors
8-pin EPS
1x 16-pin
Boost clock speed
1837 MHz
2550 MHz
Core clock speed
-
2295 MHz
Manufacturing process technology
4 nm
5 nm
Number of transistors
80,000 million
45,900 million
Pipelines / CUDA cores
16896
10240
Power consumption (TDP)
700 Watt
320 Watt
Texture fill rate
969.9
816.0
Memory type
HBM3
GDDR6X
Maximum RAM amount
96 GB
16 GB
Memory bus width
5120 Bit
256 Bit
Memory clock speed
2.6 GB/s
23000 MHz
Memory bandwidth
1,681 GB/s
716.8 GB/s
Shared memory
-
-
Display Connectors
No outputs
1x HDMI 2.1, 3x DisplayPort 1.4a
HDMI
-
+
DirectX
N/A
12 Ultimate (12_2)
CUDA
9.0
8.9
OpenCL
3.0
3.0
OpenGL
N/A
4.6
Shader Model
N/A
6.7
Vulkan
N/A
1.3