Re: Omnios + RSF-1 + Inifiniband
Hi, Thanks for replying. Its not from what i understand, and if it was, then I would think it would still function, the communication for RSF-1 is over ethernet. The storage network is using...
View ArticleRe: Omnios + RSF-1 + Inifiniband
I remember coming across this exact problem a long time ago setting up a similar config. I went back through some old correspondence and indeed found that it was ARP requests not being honoured by the...
View ArticleRe: I have two MCQH29-XDR mezzannie cards in different servers, that suddenly...
Hi Will, what is the OS you are using? (Win, Linux, version). which driver and version are you using? have you done any OS upgrades recently?
View ArticleRe: MLNX_OFED_LINUX-2.4-1.0.4 - test problems
In this particular use-case, when testing with pertest tools with lowest to highest message size, users should put -a flag on both the sender and receiver.
View ArticleClik here to view.
Re: I have two MCQH29-XDR mezzannie cards in different servers, that suddenly...
Great Questions!OS is Windows 2012 R2Drivers are WinOF 4.9Firmware was a custom burn version above 2_9_1000, that was working initially. 2.10.720 I believe. I have two MHQH19B-XTR's at the same...
View ArticleMellanox ConnectX-3 Ethernet Card.
Hi, I am currenly working on mellanox ConnectX-3 ethernet card. I found some tools like mlnx_qos, mlnx_qcn, and mlnx_perf but not aware about how to test it. I wanted to know more about the features...
View ArticleRe: Mellanox ConnectX-3 Ethernet Card.
Go to the Mellanox documentation server. https://mymellanox.force.comand there to /support/VF_SerialSearchEnter a valid serial number of one of your cards, then search for MLNX_QOS to find...
View ArticleRe: Omnios + RSF-1 + Inifiniband
David I assume you have dual port IB cards. You should:- connect the IB card with both switches- define per subnet a pkey (we have default and 4 pkeys from 60 to 63)Example for partition.conf:#...
View ArticleClik here to view.
Re: Mellanox ConnectX-3 Ethernet Card.
Hi,1. I suggest you start with the MLNX_OFED or MLNX_EN User Manual located on Mellanox web. Mellanox Products: Mellanox OpenFabrics Enterprise Distribution for Linux (MLNX_OFED) 2. I suggest you also...
View ArticleClik here to view.
Re: I have two MCQH29-XDR mezzannie cards in different servers, that suddenly...
Hi Will, it does sound like a bad card or a a bad slot to me, I believe that in live fish mode the card should be identified in Device manager, and also with MFT only as "SDR" or "Recovery Mode" Here's...
View ArticleRe: Designing for high availability
Hi, If you're planning to use GPFS over RDMA you'll most likely have to use IPoIB as the upper layer interface. IPoIB can use the standard linux bonding driver with an active/passive configuration, as...
View ArticleRe: Designing for high availability
I'am familiar with Infiniband, GPFS and RDMA is a single switch environment. This is straightforward and you can define your IPoIB interfaces as bond to fail over when individual links fail. I have...
View ArticleRe: Infiniband for Mellanox Technologies MT25204
which firmware update version did you use? Thanks.
View ArticleClik here to view.
Re: Omnios + RSF-1 + Inifiniband
Hi, thanks for the help, I will give it a go when I'm back at work next week, off for Easter now You are correct, using a dual port card. Again thanks for the information and that you are using...
View ArticleMellanox Messaging Library RPM
Is there an archive of the mxm RPMs available? We are trying to find a copy of the mxm RPM that is compatible with CentOS 4.4. We need to compile OpenMPI with MXM on a system running CentOS 4.4. Thank...
View ArticleClik here to view.
Re: Mellanox Messaging Library RPM
CentOS 4.4?? any chance you had a typo and you are looking for CentOS 5.4?
View ArticleRe: Mellanox Messaging Library RPM
No, unfortunately it is CentOS 4.4. This is an old cluster we are using to run a numerical model.
View ArticleRe: Mellanox Messaging Library RPM
Currently, MXM does not support CentOS 4.4 but 5.x+What OFED version do you use on that cluster? we will try to build rpm for your setup once info is provided.
View ArticleRe: Mellanox Messaging Library RPM
Thank you for your help. Here are the versions of everything we have:OFED-1.2ofa_kernel-1.2ofa_user-1.2ofed_1_2and for openmpi:openmpi-1.2.2-1
View ArticleRe: Mellanox Messaging Library RPM
mxm supports OMPI 1.6 and later. (and 64bit archs only).OMPI 1.2 is way old, as well as ofed 1.2.can you consider upgrade your system to latest?
View Article