RTX A40 and Radeon Instinct MI300X - video card comparison

RTX A40

Radeon Instinct MI300X

Architecture

Ampere (2020−2022)

CDNA 3.0

GPU code name

GA102

Aqua Vanjaram

Market segment

Desktop

Release date

October 2020

December 2023

Interface

PCIe 4.0 x16

PCIe 5.0 x16

Supplementary power connectors

8-pin EPS

None

Boost clock speed

1755 MHz

2100 MHz

Manufacturing process technology

8 nm

5 nm

Number of transistors

28,300 million

153,000 million

Pipelines / CUDA cores

10752

19456

Power consumption (TDP)

300 Watt

750 Watt

Texture fill rate

589.7

2,554

Memory type

GDDR6

HBM3

Maximum RAM amount

48 GB

192 GB

Memory bus width

384 Bit

8192 Bit

Memory clock speed

14.5 GB/s

5 GB/s

Memory bandwidth

695.8 GB/s

5,171 GB/s

Display Connectors

3x DisplayPort

No outputs

DirectX

12 Ultimate (12_2)

N/A

CUDA

8.6

OpenCL

2.0

3.0

OpenGL

4.6

N/A

Shader Model

6.5

N/A

Vulkan

1.2

N/A