Nvidia DGX A100 User Manual

Introduction to the NVIDIA DGX A100 System
NVIDIA DGX A100 DU-09821-001 _v01|2
1.1.1. DGX A100 Models and Component
Descriptions
There are two models of the NVIDIA DGX A100 system: the NVIDIA DGX A100 640GB system
and the NVIDIA DGX A100 320GB system.
Model Differentiation
Table1. Model Differentiation
Component
NVIDIA DGX A100 640GB
System
NVIDIA DGX A100 320GB
System
GPU
Qty 8 NVIDIA A100 GPUs
Third-generation NVLinks
Qty 8 NVIDIA A100 GPUs
Third-generation NVLinks
Total GPU Memory 640 GB 320 GB
NVIDIA NVSwitch
Qty 6
Second generation (2x faster
than first generation)
Qty 6
Second generation (2x faster
than first generation)
Networking
Up to 10 (Factory ship config)
NVIDIA ConnectX-6 or
ConnectX-7
InfiniBand/200 Gb/s Ethernet
Up to 9 (Factory ship config)
NVIDIA ConnectX-6 or
ConnectX-7 IB/200 Gb/s
Ethernet
(Optional Add-on: Second dual-
port 200 Gb/s Ethernet)
CPU 2 AMD Rome, 128 cores total 2 AMD Rome, 128 cores total
System Memory 2 TB (Factory ship config)
1 TB (Factory ship config)
(Optional Add-on: 1 TB to get 2
TB max.)
Storage
30 TB (Factory ship config)
U.2 NVMe Drives
(Optional drive upgrade to 60 TB)
15 TB (Factory ship config)
U.2 NVMe Drives
(Optional Add-on: 15 TB to get 30
TB max.
Optional drive upgrade to 60 TB)

Nvidia DGX A100 Specifications

General

Brand	Nvidia
Model	DGX A100
Category	Computer Hardware
Language	English