L40S and Radeon Instinct MI300X - video card comparison

L40S

Radeon Instinct MI300X

Architecture

Ada Lovelace

CDNA 3.0

GPU code name

AD102

Aqua Vanjaram

Market segment

Desktop

Release date

October 2022

December 2023

Interface

PCIe 4.0 x16

PCIe 5.0 x16

Supplementary power connectors

1x 16-pin

None

Boost clock speed

2520 MHz

2100 MHz

Manufacturing process technology

5 nm

Number of transistors

76,300 million

153,000 million

Pipelines / CUDA cores

18176

19456

Power consumption (TDP)

300 Watt

750 Watt

Texture fill rate

1,431

2,554

Memory type

GDDR6

HBM3

Maximum RAM amount

48 GB

192 GB

Memory bus width

384 Bit

8192 Bit

Memory clock speed

18 GB/s

5 GB/s

Memory bandwidth

864.0 GB/s

5,171 GB/s

Display Connectors

1x HDMI 2.1, 3x DisplayPort 1.4a

No outputs

HDMI

DirectX

12 Ultimate (12_2)

N/A

CUDA

8.9

OpenCL

3.0

OpenGL

4.6

N/A

Shader Model

6.7

N/A

Vulkan

1.3

N/A