A100 PCIe and GeForce RTX 4090 - video card comparison

A100 PCIe

GeForce RTX 4090

Architecture

Ampere (2020−2022)

Ada Lovelace

GPU code name

GA100

AD102-300-A1

Market segment

Desktop

Desktop

Release date

June 2020

September 2022

Interface

PCIe 4.0 x16

PCIe 4.0 x16

Supplementary power connectors

1x 8-pin

1x 16-pin

Boost clock speed

-

2520 MHz

Core clock speed

1410 MHz

2235 MHz

Manufacturing process technology

7 nm

5 nm

Number of transistors

54,200 million

76,300 million

Pipelines / CUDA cores

6912

16384

Power consumption (TDP)

250 Watt

450 Watt

Texture fill rate

609.1

1,290

Memory type

HBM2e

GDDR6X

Maximum RAM amount

40 GB

24 GB

Memory bus width

5120 Bit

384 Bit

Memory clock speed

2.4 GB/s

21000 MHz

Memory bandwidth

1,555 GB/s

1,008 GB/s

Shared memory

-

-

Display Connectors

No outputs

1x HDMI 2.1, 3x DisplayPort 1.4a

HDMI

-

+

DirectX

12 Ultimate (12_2)

12 Ultimate (12_2)

CUDA

8.0

8.9

OpenCL

2.0

3.0

OpenGL

4.6

4.6

Shader Model

6.5

6.6

Vulkan

1.2

1.3