Re: Will there be ESXi 5.x driver support for ConnectX adapters?
I've run through all of the command and configuration recommendations in the user manuals, best I can get is 2044 MTU. Could possibly be opensm not listening to my partitions.conf file as when I run...
View ArticleRe: Will there be ESXi 5.x driver support for ConnectX adapters?
Hi wark286,Indeed, looks like your opensm is not listening to the config file (the test you've done using saquery reflects this fact).If you're running opensm from a host, try to run it manually:>...
View ArticleRe: Will there be ESXi 5.x driver support for ConnectX adapters?
Looks like running it from command line and specifying the file did the trick, hadn't used the -P argument previously. Not sure why it wasn't reading correctly when running as a service in Windows,...
View ArticleRe: Dual port FDR connectx-3 card
What gadis said. If for no other reason then PCIe3 x8 has a theoretical max bandwidth of about 56Gbps.
View ArticleClik here to view.
Re: Will there be ESXi 5.x driver support for ConnectX adapters?
Interesting. I had a chance to do some testing and I found that if I connect my 2 nodes direct, I can get an active_mtu of 4096, but if I go through my switch (Voltaire ISR9024D), it drops to...
View ArticleRe: Suggestions for *quiet* Infiniband switch?
So my latest quirk is that if I connect two cards direct, I get an active_mtu of 4096, but if it passes through the switch, it drops to 2048. More digging around.
View ArticleRe: Will there be ESXi 5.x driver support for ConnectX adapters?
Also noticed something weird when I switched from my ESXi 4.1 test install to a 5.1 install. After getting the drivers installed, it connected to the infiniband network at 4x, however, when I enabled...
View ArticleRe: Dual port FDR connectx-3 card
that's correct.X16 should give you better ability with both ports - the card can. it is what's underneath it that is limiting us. :-)
View ArticleRe: dual port FDR ConnectX-3 card
Redirecting you to this thread - same question: Dual port FDR connectx-3 card
View ArticleRe: MCQH29-XDR firmware for RDMA
I managed to flash my Dell mezzanine cards with firmware version 2.10.720, and I wrote an article about it. RDMA is now enabled, and maximum throughput of an SMB share, measured using IOMeter, improved...
View ArticleRe: Mellanox (old Voltaire) ISR9024D-M recover flash area
Hi yairi! Thank you for your reply. I'll check it this weekend and reply on this thread...:)
View ArticleClik here to view.
Re: sx1036 as IB-to IP gateway
Thanks a lot for the very informative image. A short follow-up question:Is it so that the blocked ports are caused by using split cables? example: port 4 uses a 4*10G split cable so port 1 is...
View ArticleRebuilding OFED 1.5.3 for new Linux kernel
I administer a HP cluster of 3 head nodes and 60 compute nodes. All run RHEL 6.2 x86_64 with kernel 2.6.32-220. All nodes have Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR /...
View ArticleInfiniband on Linux... defaults to datagram mode somehow?
RHEL v5.5kernel 2.6.18-194.el5 What I have discovered, is that if you don't have "ONBOOT=yes" in your ifcfg-ib# script... the interface will come up in "datagram" mode, regardless of what is in...
View ArticleRe: Infiniband on Linux... defaults to datagram mode somehow?
Are you using MLNX OFED 2.0?Starting from MLNX OFED 2.0, the default mode is UD.From the User Manual section 1.3.4:The IP over IB (IPoIB) driver is a network interface implementation over InfiniBand....
View ArticleRe: Infiniband on Linux... defaults to datagram mode somehow?
Well, I think its just what comes with the kernel source... ################################################################################ module ib_ipoib filename:...
View ArticleRe: Will there be ESXi 5.x driver support for ConnectX adapters?
hii tried some older ConnectX1 HP Mezzanine cards. upgrade the firmware to 1.2 (from memory)and use the older version on ESXi 5.0 driverDownload Drivers v1.8.0 for ESXi 5.X (Builds: 469512 &...
View ArticleRe: Rebuilding OFED 1.5.3 for new Linux kernel
hiwe face a similar problem. The only way to solve it is to run a pre-prod cluster. install the updates and test it. (takes a few hours) we use HP C7000 blades with HP BL460 and 465 G7 Servers using...
View ArticleClik here to view.
ConnectX-2: Enabling RSS (Receive Side Scaling) in IPoIB mode
Hello, I'm using Mellanox ConnectX-2 40Gb/s adapters for filtering IP traffic on an HP 4xOpteron server. The server receives traffic via an HP Infiniband-only switch, so using mlx4_en is not an option....
View ArticleRe: Rebuilding OFED 1.5.3 for new Linux kernel
Thanks! Your links are helpful. The idea of using a non-cluster system to build the OFED RPMs was especially useful. The comments appended to the first link have some interesting opinions regarding...
View Article