Nvidia DGX-1 User Manual

Preparing for Using Docker Containers
www.nvidia.com
NVIDIA DGX-1 DU-08033-001 _v13.1|23
1.
Open the docker-override.conf file for editing.
$ sudo vi /etc/systemd/system/docker.service.d/docker-override.conf
[Service]
ExecStart=
ExecStart=/usr/bin/dockerd -H fd:// -s overlay2 --disable-legacy-
registry=false
LimitMEMLOCK=infinity
LimitSTACK=67108864
2.
Make the changes indicated in bold below, setting the correct bridge IP address and
IP address ranges for your network. Consult your IT administrator for the correct
addresses.
[Service]
ExecStart=
ExecStart=/usr/bin/dockerd -H fd:// -s overlay2 --bip=192.168.127.1/24
--fixed-cidr=192.168.127.128/25
--disable-legacy-registry=false
LimitMEMLOCK=infinity
LimitSTACK=67108864
Save and close the /etc/systemd/system/docker.service.d/docker-
override.conf file when done.
3.
Reload the systemctl daemon.
$ sudo systemctl daemon-reload
4.
Restart Docker.
$ sudo systemctl restart docker
3.3.Letting Users Issue Docker Commands
To prevent the docker daemon from running without protection against escalation of
privileges, the NVIDIA Docker software requires sudo privileges to run containers.
You can grant the required privileges to users who will run containers on the DGX-1 in
one of the following ways:
‣
Add each user as an administrator user with sudo privileges.
‣
Add each user as a standard user without sudo privileges and then add the user to
the docker group.
This section provides instructions for adding users to the docker group.
WARNING: Only add users to the docker group whom you would trust with root
privilege. These instructions make it more convenient for users to access Docker
containers; however, the resulting docker group is equivalent to the root user,
because once a user is able to send commands to the Docker engine, they are able to
escalate privilege and run root level operations. This may violate your organization's
security policies. See the Docker Daemon Attack Surface for information on how this

Nvidia DGX-1 Specifications

General

RAM	512 GB DDR4
Form Factor	4U Rackmount
CPU	2 x Intel Xeon E5-2698 v4
Storage	4 x 1.92 TB NVMe SSD
Network	Dual 10 GbE
Interconnect	NVIDIA NVLink
Power Supply	3200W (redundant)
Operating System	Ubuntu Linux with NVIDIA DGX software stack
Dimensions	19 in
GPU	8x NVIDIA Tesla P100 GPUs

Summary

Introduction to the NVIDIA DGX-1 Deep Learning System

Hardware Specifications

Detailed specifications of the DGX-1's hardware components.

Installation and Setup

Choosing a Setup Location / Site Preparation

Installing the DGX-1 Into a Rack

Procedures for mounting the DGX-1 into a server rack.

Connecting the Power Cables

Connecting the Network Cables

Guide for connecting Ethernet and IPMI network cables.

Setting Up the DGX-1

Initial system configuration process after powering on the DGX-1.

Preparing for Using Docker Containers

Installing Docker and NVIDIA Docker on DGX OS Server Software 2.x or Earlier

Installing Docker and NVIDIA Docker for older DGX OS versions.

Configuring Docker IP Addresses

Configuring Docker network IP addresses to prevent conflicts.

Configuring and Managing the DGX-1

Using the BMC

Introduction to the Baseboard Management Controller (BMC) for system management.

Configuring a Static IP Address for the BMC

Setting a static IP address for the BMC.

Configuring Static IP Addresses for the Network Ports

Setting static IP addresses for network interfaces.

Maintaining and Servicing the NVIDIA DGX-1

Restoring the DGX-1 Software Image

Procedures to restore the DGX-1 software image to factory settings.

Updating the System BIOS

Remotely updating the system BIOS via the BMC.

Updating the BMC

Remotely updating the BMC firmware using the IPMI port.

Replacing the System and Components

Overview of replaceable components and RMA process.

Installing Software on Air-Gapped NVIDIA DGX-1 Systems

Installing NVIDIA DGX-1 Software

Installing Docker Containers

Safety

Safety Warnings and Cautions

General safety warnings and cautions for DGX-1 operation.

Electrical Precautions

System Access Warnings

Rack Mount Warnings

Electrostatic Discharge