H100 SXM5 96 GB and Radeon Instinct MI300 - video card comparison
H100 SXM5 96 GB
Radeon Instinct MI300
Architecture
Hopper (2022)
CDNA 3.0
GPU code name
GH100
Aqua Vanjaram
Market segment
Desktop
Desktop
Release date
March 2023
January 2023
Interface
PCIe 5.0 x16
PCIe 5.0 x16
Supplementary power connectors
8-pin EPS
2x 8-pin
Boost clock speed
1837 MHz
1700 MHz
Manufacturing process technology
4 nm
5 nm
Number of transistors
80,000 million
153,000 million
Pipelines / CUDA cores
16896
14080
Power consumption (TDP)
700 Watt
600 Watt
Texture fill rate
969.9
1,496
Memory type
HBM3
HBM3
Maximum RAM amount
96 GB
128 GB
Memory bus width
5120 Bit
8192 Bit
Memory clock speed
2.6 GB/s
3.2 GB/s
Memory bandwidth
1,681 GB/s
3,277 GB/s
Display Connectors
No outputs
No outputs
DirectX
N/A
N/A
CUDA
9.0
-
OpenCL
3.0
3.0
OpenGL
N/A
N/A
Shader Model
N/A
N/A
Vulkan
N/A
N/A