Network Configuration
NVIDIA DGX A100 DU-09821-001 _v01|46
‣
If port 1 is Ethernet, then port 2 (InfiniBand) does not support EDR.
7.7.1. Starting the Mellanox Software Tools and
Determining the Current Port Configuration
Here is some information about how you can start the Mellanox software tools and determine
the configuration for the current port.
Start the Mellanox Software Tools services.
$ sudo mst start
To determine the current port configuration, enter the following:
$ sudo mlxconfig -e query | egrep -e Device\|LINK_TYPE
The following example shows the output for one of the port devices, showing the device path
and the default, current, and next boot configuration.
Device #2:
Device type: ConnectX6
Device: /dev/mst/mt4123_pciconf8
Configurations: Default Current Next Boot
* LINK_TYPE_P1 IB(1) IB(1) IB(1)
‣
IB(1) indicates the port is configured for InfiniBand.
‣
ETH(2) indicates the port is configured for Ethernet.
Determine the Device path bus numbers for the slot number of the port you want to configure.
Refer to the table in Open Ports for the mapping.
7.7.2. Switching the Port Configuration
Make sure that you have started the Mellanox Software Tools (MST) services as described in
Starting the Mellanox Software Tools and Determining the Current Port Configuration and
have identified the correct ports to change.
Issue mlxconfig for each port you want to configure.
$ sudo mlxconfig -y -d <device-path> set LINK_TYPE_P1=<config-number>
where:
‣
<device-path> corresponds to the port you want to configure.
‣
<config-number> is 1 for InfiniBand and 2 for Ethernet.
Here is an example to set slot 0 to Ethernet:
$ sudo mlxconfig -y -d /dev/mst/mt4123_pciconf2 set LINK_TYPE_P1=2
Here is an example that sets slot 1 to InfiniBand:
$ sudo mlxconfig -y -d /dev/mst/mt4123_pciconf3 set LINK_TYPE_P1=1