Thanks Andre,
My kernels are all pretty new and should all accept ofed 2.2 (CentOS 6.3 and 6.5, and also CentOS 6.2 that will be soon updated to 6.5). All supported according 2.2-1.0.1 release notes.
My problem comes with my cards. They are all 2~3 years old and there seems to be no more firmware updates for them. The mellanox ofed installer says they are up to date or cannot be updated with newer firmwares:
- Compute:
Image type: ConnectX
FW Version: 2.9.1100
Device ID: 26428
PSID: IBM08B0130009
Mellanox equivalent model: No match
max firm connectX2 = 2.9.1000
http://old.mellanox.com/content/pages.php?pg=firmware_table_IBM
Latest release: 08 aug 11
- Dell GPFS servers:
Image type: ConnectX
FW Version: 2.9.1000
Device ID: 26428
PSID: MT_0D90110009
Mellanox equivalent model:
Single 4X IB QDR Port, PCIe Gen2 x8, Tall Bracket, RoHS-R6 HCA Card, QSFP Connector
Max firmware available: 2.9.1000
Latest release:09 June 11
- IBM spare nodes
Image type: FS2
FW Version: 2.11.500
Device ID: 4099
PSID: IBM1020110028
Mellanox equivalent model:
MT_1020110028
ConnectX-3 VPI adapter card; dual-port QSFP; FDR10 IB (40Gb/s) and 10GigE; PCIe3.0x8 8GT/s; RoHS R6 PCI DevID: 4099
Max firmware available: 2.31.5050
http://old.mellanox.com/content/pages.php?pg=firmware_table_IBM
Max firmware available for the IBM OEM version: 2.11.0500
Latest release:15 Nov 12
While 2.2 release notes require:
- ConnectX-3: 2.31.5050 or above
- ConnectX-2: 2.9.1200 or above
But 1.5.3 requirements are fine:
- ConnectX-2 / ConnectX-2 EN (fw-ConnectX2 Rev 2.9.1000)
- ConnectX-3 VPI / ConnectX-3 EN (fw-4099 Rev 2.11.0500)
So, I suppose I should keep everything with 1.5.3, and install 2.2 in new nodes but setting them to CM while old nodes exist.
Thanks,
Txema