MCX556A-ECAT doesn't work on FreeBSD 14.1R

Rex Ai

Rex Ai

Code: 
# dmesg -a
...
mlx5_core0: <mlx5_core> mem 0xc2000000-0xc3ffffff at device 0.1 numa-domain 5 on pci35
msi_map: unsupported destination APIC ID 324
mlx5_core0: WARN: mlx5_start_eqs:577:(pid 62837): failed to create cmd EQ -22
mlx5_core0: ERR: mlx5_load_one:1197:(pid 62837): Failed to start pages and async EQs
mlx5_core0: ERR: init_one:1694:(pid 62837): mlx5_load_one failed -22 device_attach: mlx5_core0 attach returned 22
...

I tried to upgrade the firmware:
Code: 
# mlxfwmanager --online -u
Querying Mellanox devices firmware ...

Device #1:
----------

  Device Type:      ConnectX5
  Part Number:      MCX556A-ECA_Ax
  Description:      ConnectX-5 VPI adapter card; EDR IB (100Gb/s) and 100GbE; dual-port QSFP28; PCIe3.0 x16; tall bracket; ROHS R6
  PSID:             MT_0000000008
  PCI Device Name:  pci1:5:0:0
  Base GUID:        b8599f0300d08962
  Versions:         Current        Available
     FW             16.24.1000     16.35.4030
     PXE            3.5.0603       3.6.0902
     UEFI           14.17.0011     14.29.0015

  Status:           Update required

Release notes for the available Firmware:
-----------------------------------------

  For more details, please refer to the following FW release notes:
    1- ConnectX3 (2.42.5000):    http://www.mellanox.com/pdf/firmware/ConnectX3-FW-2_42_5000-release_notes.pdf
    2- ConnectX3Pro (2.42.5000): http://www.mellanox.com/pdf/firmware/ConnectX3Pro-FW-2_42_5000-release_notes.pdf
    3- Connect-IB (10.16.1200):  http://www.mellanox.com/pdf/firmware/ConnectIB-FW-10_16_1200-release_notes.pdf
    4- ConnectX4 (12.28.2006):   http://docs.mellanox.com/display/ConnectX4Firmwarev12282006
    5- ConnectX4Lx (14.32.1010): http://docs.mellanox.com/display/ConnectX4LxFirmwarev14321010
    6- ConnectX5 (16.35.4030):   http://docs.mellanox.com/display/ConnectX5Firmwarev16354030
    7- ConnectX6 (20.42.1000):   http://docs.mellanox.com/display/ConnectX6Firmwarev20421000
    8- ConnectX6Dx (22.42.1000):   http://docs.mellanox.com/display/ConnectX6DxFirmwarev22421000
    9- ConnectX6Lx (26.42.1000):   http://docs.mellanox.com/display/ConnectX6LxFirmwarev26421000
    10- BlueField2 (24.42.1000):   http://docs.mellanox.com/display/BlueField2Firmwarev24421000
    11- ConnectX7 (28.42.1000):   http://docs.mellanox.com/display/ConnectX7Firmwarev28421000
    12- BlueField3 (32.42.1000):   http://docs.mellanox.com/display/BlueField3Firmwarev32421000

Device #2:
----------

  Device Type:      ConnectX5
  Part Number:      MCX556A-ECA_Ax
  Description:      ConnectX-5 VPI adapter card; EDR IB (100Gb/s) and 100GbE; dual-port QSFP28; PCIe3.0 x16; tall bracket; ROHS R6
  PSID:             MT_0000000008
  PCI Device Name:  pci1:69:0:0
  Base GUID:        b8599f0300c64be6
  Versions:         Current        Available
     FW             16.24.1000     16.35.4030
     PXE            3.5.0603       3.6.0902
     UEFI           14.17.0011     14.29.0015

  Status:           Update required

Release notes for the available Firmware:
-----------------------------------------

  For more details, please refer to the following FW release notes:
    1- ConnectX3 (2.42.5000):    http://www.mellanox.com/pdf/firmware/ConnectX3-FW-2_42_5000-release_notes.pdf
    2- ConnectX3Pro (2.42.5000): http://www.mellanox.com/pdf/firmware/ConnectX3Pro-FW-2_42_5000-release_notes.pdf
    3- Connect-IB (10.16.1200):  http://www.mellanox.com/pdf/firmware/ConnectIB-FW-10_16_1200-release_notes.pdf
    4- ConnectX4 (12.28.2006):   http://docs.mellanox.com/display/ConnectX4Firmwarev12282006
    5- ConnectX4Lx (14.32.1010): http://docs.mellanox.com/display/ConnectX4LxFirmwarev14321010
    6- ConnectX5 (16.35.4030):   http://docs.mellanox.com/display/ConnectX5Firmwarev16354030
    7- ConnectX6 (20.42.1000):   http://docs.mellanox.com/display/ConnectX6Firmwarev20421000
    8- ConnectX6Dx (22.42.1000):   http://docs.mellanox.com/display/ConnectX6DxFirmwarev22421000
    9- ConnectX6Lx (26.42.1000):   http://docs.mellanox.com/display/ConnectX6LxFirmwarev26421000
    10- BlueField2 (24.42.1000):   http://docs.mellanox.com/display/BlueField2Firmwarev24421000
    11- ConnectX7 (28.42.1000):   http://docs.mellanox.com/display/ConnectX7Firmwarev28421000
    12- BlueField3 (32.42.1000):   http://docs.mellanox.com/display/BlueField3Firmwarev32421000

---------
Found 2 device(s) requiring firmware update...

Perform FW update? [y/N]: y

Please wait while downloading MFA(s) 100%
Device #1: Updating FW ...
FSMST_INITIALIZE -   OK
Writing Boot image component -   OK
Done
Device #2: Updating FW ...
FSMST_INITIALIZE -   OK
Writing Boot image component -   OK
Done

Restart needed for updates to take effect.

Then switched the work mode from Infiniband to Ethernet:
Code: 
# mst status                                                                                 
MST devices:                                                                                             
------------                                                                                             
  pci1:5:0:0    -       MT27800 Family [ConnectX-5]                                                     
  pci1:69:0:0   -       MT27800 Family [ConnectX-5]

# mlxconfig -d pci1:5:0:0 set LINK_TYPE_P1=2 LINK_TYPE_P2=2                                 
                                                                                                        
Device #1:                                                                                               
----------                                                                                               
                                                                                                        
Device type:        ConnectX5                                                                           
Name:               MCX556A-ECA_Ax                                                                       
Description:        ConnectX-5 VPI adapter card; EDR IB (100Gb/s) and 100GbE; dual-port QSFP28; PCIe3.0 x1
6; tall bracket; ROHS R6                                                                                 
Device:             pci1:5:0:0         

Configurations:                                          Next Boot       New
        LINK_TYPE_P1                                IB(1)                ETH(2)             
        LINK_TYPE_P2                                IB(1)                ETH(2)             

 Apply new Configuration? (y/n) [n] : y
Applying... Done!
-I- Please reboot machine to load new configurations.

# mlxconfig -d pci1:69:0:0 set LINK_TYPE_P1=2 LINK_TYPE_P2=2

Device #1:
----------

Device type:        ConnectX5         
Name:               MCX556A-ECA_Ax     
Description:        ConnectX-5 VPI adapter card; EDR IB (100Gb/s) and 100GbE; dual-port QSFP28; PCIe3.0 x1
6; tall bracket; ROHS R6
Device:             pci1:69:0:0       

Configurations:                                          Next Boot       New
        LINK_TYPE_P1                                IB(1)                ETH(2)             
        LINK_TYPE_P2                                IB(1)                ETH(2)             

 Apply new Configuration? (y/n) [n] : y
Applying... Done!
-I- Please reboot machine to load new configurations.

After rebooting, I still meet the same dmesg error and it doesn't work.

Thanks for your help.
 
You must log in or register to reply here.
Back
Top