H100 PCIe and GeForce RTX 3060 Ti GDDR6X - video card comparison

H100 PCIe

GeForce RTX 3060 Ti GDDR6X

Architecture

Hopper (2022)

Ampere (2020−2022)

GPU code name

GH100

GA104

Market segment

Desktop

Release date

March 2022

October 2022

Interface

PCIe 5.0 x16

PCIe 4.0 x16

Supplementary power connectors

8-pin EPS

1x 12-pin

Boost clock speed

1650 MHz

1665 MHz

Manufacturing process technology

4 nm

8 nm

Number of transistors

80,000 million

17,400 million

Pipelines / CUDA cores

7296

4864

Power consumption (TDP)

350 Watt

225 Watt

Texture fill rate

752.4

253.1

Memory type

HBM2e

GDDR6X

Maximum RAM amount

80 GB

8 GB

Memory bus width

5120 Bit

256 Bit

Memory clock speed

2 GB/s

19 GB/s

Memory bandwidth

1,280 GB/s

608.3 GB/s

Display Connectors

No outputs

1x HDMI 2.1, 3x DisplayPort 1.4a

HDMI

DirectX

N/A

12 Ultimate (12_2)

CUDA

9.0

8.6

OpenCL

3.0

OpenGL

N/A

4.6

Shader Model

N/A

6.7

Vulkan

N/A

1.3