A100 PCIe and Radeon Instinct MI300X - video card comparison

A100 PCIe

Radeon Instinct MI300X

Architecture

Ampere (2020−2022)

CDNA 3.0

GPU code name

GA100

Aqua Vanjaram

Market segment

Desktop

Release date

June 2020

December 2023

Interface

PCIe 4.0 x16

PCIe 5.0 x16

Supplementary power connectors

1x 8-pin

None

Boost clock speed

2100 MHz

Core clock speed

1410 MHz

Manufacturing process technology

7 nm

5 nm

Number of transistors

54,200 million

153,000 million

Pipelines / CUDA cores

6912

19456

Power consumption (TDP)

250 Watt

750 Watt

Texture fill rate

609.1

2,554

Memory type

HBM2e

HBM3

Maximum RAM amount

40 GB

192 GB

Memory bus width

5120 Bit

8192 Bit

Memory clock speed

2.4 GB/s

5 GB/s

Memory bandwidth

1,555 GB/s

5,171 GB/s

Display Connectors

No outputs

DirectX

12 Ultimate (12_2)

N/A

CUDA

8.0

OpenCL

2.0

3.0

OpenGL

4.6

N/A

Shader Model

6.5

N/A

Vulkan

1.2

N/A