H100 PCIe and Jetson AGX Orin 64 GB - video card comparison

H100 PCIe

Jetson AGX Orin 64 GB

Architecture

Hopper (2022)

Ampere (2020−2022)

GPU code name

GH100

GA10B

Market segment

Desktop

Release date

March 2022

March 2023

Interface

PCIe 5.0 x16

PCIe 4.0 x4

Supplementary power connectors

8-pin EPS

Boost clock speed

1650 MHz

Core clock speed

1300 MHz

Manufacturing process technology

4 nm

8 nm

Number of transistors

80,000 million

Pipelines / CUDA cores

7296

2048

Power consumption (TDP)

350 Watt

60 Watt

Texture fill rate

752.4

83.20

Memory type

HBM2e

LPDDR5

Maximum RAM amount

80 GB

64 GB

Memory bus width

5120 Bit

256 Bit

Memory clock speed

2 GB/s

6.4 GB/s

Memory bandwidth

1,280 GB/s

204.8 GB/s

Display Connectors

No outputs

Portable Device Dependent

DirectX

N/A

12 Ultimate (12_2)

CUDA

9.0

8.6

OpenCL

3.0

OpenGL

N/A

4.6

Shader Model

N/A

6.7

Vulkan

N/A

1.3