Confusion with Packet and Byte counters for RoCE over CX3
We are using RoCE over a CX3 (RHEL 6.4) driver: mlx4_enversion: 2.1 (Apr 3 2013)firmware-version: 2.11.500 We are confused by the RoCE packet and byte counters. Eg, cat...
View ArticleRe: Suggestions for *quiet* Infiniband switch?
Since you're shopping for deprecated gear and warranty isn't an issue, you can try swapping the fans out for quieter ones. My Topspin 90 uses standard fans with a custom connector which can be taken...
View ArticleRe: Confusion with Packet and Byte counters for RoCE over CX3
The man page for perfquery states that only the data counters are divided by 4. It doesn't say anything about packets counters.Note: In PortCounters, PortCountersExtended, PortXmitDataSL, and...
View ArticleClik here to view.
Re: Confusion with Packet and Byte counters for RoCE over CX3
Thank you for the confirmation that the byte counters are a factor of 4. I suspect you are right about the packet counters as well... I will double check. It's too bad "perfquery" doesn't work in a...
View ArticleIs it possible to mount and boot from a SRP or iSER target ?.
Hi, I am looking at running diskless machines with infiniband connectivity (SRP or iSER). I wish to use CentOS and would like to boot from either a SRP or iSER target rather than have a local disk,...
View ArticleRe: SX1016 trunked to a Brocade SX800
Hi Yairi, We have just purchased silver support from colfax for this switch and are currently waiting on login details for the mellanox support website. Regards, Rob
View ArticleClik here to view.
Re: SX1016 trunked to a Brocade SX800
For those watching this thread. I believe i'm closer to sorting out what the problem is. What we are seeing is a type of Q in Q . I'm starting to think that this switch has some network virtualization...
View ArticleMLNX fails to install RPMS Centos 6.3
I have a brand new Dell system with M620 nodes and infinitband network, and is trying to set them up. When trying to run the install script it fails right after mvapich_gcc rpm has been installed, with...
View ArticleRe: MLNX fails to install RPMS Centos 6.3
Hi Coiter, Please look at the /tmp folder, the OFED installation logs should be there at a directory with the following syntax OFED.xxxxx.logs where xxxxx is a random number,for example:OFED.22033.logs...
View ArticleRe: MLNX fails to install RPMS Centos 6.3
You are absolutly right, it was the libgfortran that stopped the process, and the install now finished as it should.
View ArticleFailed loading HCA driver and Access Layer
Im sorry to ask again, im new to Infiniband so dont know all the tricks and hwo to make it work just yet:) I managed to install the software as to previous article, and rebooted the blade node. when i...
View ArticleClik here to view.
Re: ConnectX-3 CX312A-XCBT and Thunderbolt
The Mellanox ConnectX-3 should not be physicaly aware that it is connected to a Thunderbolt adapter and should linkup on the PCIe with the adapter.So I see two options to why this is not working:1. The...
View ArticleUsing ConnectX-2 VPI adapters for network workstation with 2 nodes.
I am in the process of building a small rack mount setup for CG animation/rendering using Supermicro barebone servers for LGA 2011 Intel Xeon E5 chips. It it will consist of one workstation and two...
View ArticleClik here to view.
Re: ConnectX-3 CX312A-XCBT and Thunderbolt
According to Sonnet Tech support:"Feedback from our engineering dept...... We're going to have to investigate this. It looks like a problem with PCIe 3.0 to PCIe 2.0 ..." That was back on 30 March. I...
View ArticleClik here to view.
Re: Using ConnectX-2 VPI adapters for network workstation with 2 nodes.
Yes, you can plug a cable between two ports directly but you need to start the Subnet Manager on one machine (/etc/init.d/opensmd, it can be on any machine) What you lose is scalability, of course. But...
View ArticleRe: Suggestions for *quiet* Infiniband switch?
hi. well we have the same problem. we started with Topspin 3012 switch... Ouch... loud as. so it got shoved into a sound proof chassis. didnt really solve it, so we took the fan modules out and...
View ArticleRe: Hi all!
yup we had same problem, only way is to void warranty and replace fans, and keep in aircon DC
View ArticleRe: Is it possible to mount and boot from a SRP or iSER target ?.
Someone had pointed me in this direction but it seems still to rely on IPoIB which I really would like to be without on my Infiniband network.
View ArticleRe: Is it possible to mount and boot from a SRP or iSER target ?.
Yep, I suspect that it is not doable without the inclusion of IPoIB currently which is a shame. I would imagine I will have to do a minimal PXE boot with IB drivers and mount SRP targets to the usual...
View Article