Nvidia DGX-2 SYSTEM User Manual

Network Configuration
DGX-2 System User Guide
42
Device: 0000:e6:00.0
LINK_TYPE_P1 ETH (1)
Device #8:
Device type: ConnectX4
Device: 0000:58:00.0
LINK_TYPE_P1 ETH (1)
Device #9:
Device type: ConnectX5
Device: 0000:86:00.0
LINK_TYPE_P1 ETH(2)
LINK_TYPE_P2 ETH(2)
5.8.4 Switching the Port from Ethernet to
InfiniBand
Make sure that you have started the Mellanox Software Tools (MST) as explain in the
section Starting the Mellanox Software Tools
, and have identified the correct ports to
change.
1. Change the configuration for the network cluster ports to InfiniBand by setting
LINK_TYPE_P1=1 for each port.
The following example configures all 8 network cluster ports.
~$ sudo mlxconfig -y -d /dev/mst/mt4119_pciconf0 set LINK_TYPE_P1=1
~$ sudo mlxconfig -y -d /dev/mst/mt4119_pciconf1 set LINK_TYPE_P1=1
~$ sudo mlxconfig -y -d /dev/mst/mt4119_pciconf2 set LINK_TYPE_P1=1
~$ sudo mlxconfig -y -d /dev/mst/mt4119_pciconf3 set LINK_TYPE_P1=1
~$ sudo mlxconfig -y -d /dev/mst/mt4119_pciconf4 set LINK_TYPE_P1=1
~$ sudo mlxconfig -y -d /dev/mst/mt4119_pciconf5 set LINK_TYPE_P1=1
~$ sudo mlxconfig -y -d /dev/mst/mt4119_pciconf6 set LINK_TYPE_P1=1
~$ sudo mlxconfig -y -d /dev/mst/mt4119_pciconf7 set LINK_TYPE_P1=1
2. Verify the configuration changes have been applied.
$ sudo mlxconfig query | egrep -e Device\|LINK_TYPE
Device #1:
Device type: ConnectX4
Device: 0000:bd:00.0
LINK_TYPE_P1 IB(1)
Device #2:
Device type: ConnectX4
Device: 0000:b8:00.0
LINK_TYPE_P1 IB(1)
Device #3:
Device type: ConnectX4
Device: 0000:3a:00.0
LINK_TYPE_P1 IB(1)
Device #4:
Device type: ConnectX4
Device: 0000:e1:00.0
LINK_TYPE_P1 IB(1)

Nvidia DGX-2 SYSTEM Specifications

General

Brand	Nvidia
Model	DGX-2 SYSTEM
Category	Computer Hardware
Language	English