Home
Nvidia
Computer Hardware
DGX H100
Nvidia DGX H100 User Manual
5
of 1
of 1 rating
92 pages
Give review
Manual
Specs
To Next Page
To Next Page
To Previous Page
To Previous Page
Loading...
NVIDIA
DGX
H100
User
Guide
1.1.7.2
Wit
h
t
he
Bezel
Remo
ved
Her
e
is
an
image
of
the
DGX
H100
system
without
a
bezel.
Important
:
Refer
to
the
section
First
Boo
t
Setup
for
instructions
on
how
to
properly
turn
t
he
system
on
or
o
.
1.1.8.
Rear
P
anel
Modules
Her
e
is
an
image
that
shows
the
real
panel
modules
on
DGX
H100.
1.1.
Har
dwar
e
Overvie
w
7
12
14
Table of Contents
Table of Contents
3
Introduction to the NVIDIA DGX H100 System
7
Hardware Overview
8
DGX H100 Models and Component Descriptions
8
Mechanical Specifications
9
Power Specifications
9
Support for 4+2 Redundancy
9
DGX H100 Locking Power Cord Specification
9
Using the Locking Power Cords
10
Environmental Specifications
11
Front Panel Connections and Controls
11
With a Bezel
11
With the Bezel Removed
13
Rear Panel Modules
13
Motherboard Connections and Controls
14
Motherboard Tray Components
15
GPU Tray Components
16
Network Connections, Cables, and Adaptors
17
Network Ports
17
Compute and Storage Networking
18
Network Modules
19
Supported Network Cables and Adaptors
20
DGX H100 System Topology
21
DGX os Software
21
Customer Support
22
Connecting to the DGX H100
23
Connecting to the Console
23
Direct Connection
23
Remote Connection through the BMC
25
SSH Connection to the os
27
First Boot Setup
29
System Setup
29
Post Setup Tasks
31
Obtaining Software Updates
31
Enabling the SRP Daemon
31
Quickstart and Basic Operation
33
Installation and Configuration
33
Registration
33
Obtaining an NGC Account
34
Turning DGX H100 on and off
34
Startup Considerations
34
Shutdown Considerations
34
Verifying Functionality - Quick Health Check
34
Running the Pre-Flight Test
35
Running NGC Containers with GPU Support
36
Using Native GPU Support
36
Using the NVIDIA Container Runtime for Docker
37
Managing CPU Mitigations
38
Determining the CPU Mitigation State of the DGX System
38
Disabling CPU Mitigations
39
Re-Enabling CPU Mitigations
39
SBIOS Settings
41
Accessing the SBIOS Setup
41
Configuring the Boot Order
42
Configuring the Local Terminal
44
Linux
44
Windows and Macos
44
Power on or Reboot the System
44
Using the Baseboard Management Controller (BMC)
45
Connecting to the BMC
45
Overview of BMC Controls
46
Changing the BMC Login Credentials
49
Using the Remote Console
49
Setting up Active Directory, LDAP, or E-Directory
49
Configuring Platform Event Filters
50
Uploading or Generating SSL Certificates
51
Viewing the SSL Certificate
51
Generating the SSL Certificate
52
Uploading the SSL Certificate
53
Updating the SBIOS Certificate
53
Security
57
User Security Measures
57
Securing the BMC Port
57
System Security Measures
57
Secure Flash of DGX H100 Firmware
58
Encryption
58
NVIDIA System Manager Security
58
Secure Data Deletion
58
Prerequisites
58
Procedure
59
Redfish Apis Support
61
Supported Redfish Features
61
Redfish Examples
62
BMC Manager
62
Firmware Update
63
BIOS Settings
65
Telemetry
66
Chassis
66
SEL Logs
67
Virtual Image
67
Collect BMC Debug Data
67
Safety
69
Safety Information
69
Safety Warnings and Cautions
69
Intended Application Uses
70
Site Selection
70
Equipment Handling Practices
71
Electrical Precautions
71
Power and Electrical Warnings
71
Power Cord Warnings
72
System Access Warnings
72
Rack Mount Warnings
73
Electrostatic Discharge
74
Other Hazards
74
California Department of Toxic Substances Control
74
Nickel
74
Battery Replacement
74
Cooling and Airflow
75
Compliance
77
United States
77
United States/Canada
77
Canada
78
Australia and New Zealand
79
Brazil
79
Japan
79
South Korea
81
China
82
Taiwan
84
Russia/Kazakhstan/Belarus
85
Israel
86
India
86
South Africa
87
Great Britain (England, Wales, and Scotland)
87
Third-Party License Notices
89
Micron Msecli
89
Mellanox (OFED)
90
Notices
91
Notice
91
Trademarks
92
Copyright
92
Other manuals for Nvidia DGX H100
Service Manual
146 pages
5
Based on 1 rating
Ask a question
Give review
Questions and Answers:
Need help?
Do you have a question about the Nvidia DGX H100 and is the answer not in the manual?
Ask a question
Nvidia DGX H100 Specifications
General
Brand
Nvidia
Model
DGX H100
Category
Computer Hardware
Language
English
Related product manuals
Nvidia DGX A100
118 pages
Nvidia JETSON DEVELOPER KIT
32 pages
Nvidia RTX 4000
145 pages
Nvidia RTX 5000
145 pages
Nvidia RTX 4500
145 pages
Nvidia TESLA K20
27 pages
Nvidia RTX 4000 SFF
145 pages
Nvidia Quadro M6000 Sync
8 pages
Nvidia Jetson AGX Orin Series
51 pages
Nvidia Jetson AGX Xavier Series
157 pages
Geforce PCI-Express Series
26 pages
Mellanox ConnectX-6 MCX654106A-ECAT
90 pages
To Next PageTo Next PageTo Previous PageTo Previous Page
Loading...
Need help?
General
