Windows 8.1 it may be possible with a specific OFED driver for this distribution such as WinOFED 4.80.
You'll need a cable that can support 10G Ethernet. see cable matrix here :
Windows 8.1 it may be possible with a specific OFED driver for this distribution such as WinOFED 4.80.
You'll need a cable that can support 10G Ethernet. see cable matrix here :
Hi,
I have informed that FCoE has not supported by ConnectX-3 VPI based card/HCA currently so the information on http://www.mellanox.com/related-docs/prod_silicon/PB_ConnectX3_VPI_Silicon.pdf is not valid. It seem the FCoE support is a roadmap. Any valid information of this issue?
Best regards,
Is it possible to view the VF counters for IB? Looks like it is not possible to get this information currently.
In the following example mlx4_0 is the PF and mlx4_1 and mlx4_2 are two probed VFs.
# cat /sys/class/infiniband/mlx4_0/ports/1/counters/port_xmit_data
16199496
# cat /sys/class/infiniband/mlx4_1/ports/1/counters/port_xmit_data
cat: /sys/class/infiniband/mlx4_1/ports/1/counters/port_xmit_data: Invalid argument
# cat /sys/class/infiniband/mlx4_2/ports/1/counters/port_xmit_data
cat: /sys/class/infiniband/mlx4_2/ports/1/counters/port_xmit_data: Invalid argument
Hi,
I've just received two of these cards (MHEA28-XTC) and popped them into a workstation and a server, the goal is a 10GbE connection between the two.
After installing Win_OF I get code 10 errors in the device manager, saying the device won't start, I've tried several drivers that come with the Win_OF package but none seem to get past error 10.
Someone on here had the same error with a different card, and updating the firmware was suggested, so after trying MFT3.8.0 and figuring out that it doesn't play nicely with these cards I reverted to MFT2.7.1. Using Mlxburn in the package I wrote the 5.3.000 firmware to the card, after this I still get error 10 (device can't start)
After trying to query the firmware version on the card, the machine froze up and only came back to life after pulling it's power plug, so I guess there's something there...
Anyway, can these cards be made to work in Server 2012 R2? It's for a test lab not production so even if it requires a 'shady' workaround that's fine.
Hopefully somebody can help me,
Robin
Hi guys
Just wanted to let you know, that it was all about a driver problem.
When installing the OFED 1.8.2.4 both ports show up as vmnic_ib0/1 so using IPoIB.
Then I installed the same driver on the second host, so that in theory both use IPoIB but for whatever reason I got no link (host to host cross cabling) on both hosts.
So I finally decided to install the latest Ethernet driver and to live with just a single 10GbE Link.
Thanks for your support.
Patrick.
Thank you for the answer Erez.
One more thing:
¿is SFP+ cable make it of copper or is an optic cable? I need connect two computers at 10 meters. In the same via than 10Gbps link interface I need put also: USB3s cables, TV/satellite/TDT cables and electric cables (<1000W). Optic cable is a best option? Optic or copper cable is it the same for my needs? What is an transceiver? transceiver is needed for connect an optic cable to this card? transceiver is needed for connect an copper cable to this card? SFP+ can accept optic and copper cable or only optic? is not possible put the cable directly to the card??
Sorry for the basic questions. It's my first time with infiniband
Thank you!!
Hi, folks
We are trying to choose a kernel for our produce and 3.18 was preferred, but according to the release notes 3.17 is the highest support version.
But after I download the tarball, I found file 'MLNX_OFED_README_v2.4-1.0.0' under 'docs', which telling that 3.18 was supported...
Again I check the release notes of 2.4.1.0.0, it also said 3.17 is the highest.
So i was totally confused:
1. why tarball of 2.4.1.0.4 contain the readme of 2.4.1.0.0?
2. Is there a version support kernel 3.18?
We appreciate if anyone can answer the question :-)
Regards,
Michael Wang
Hi, folks
We have some private commits for infiniband stuff, and we also want MLNX OFED too, so seems like the
best way is to import MLNX OFED project into kernel tree then apply our patches on top of it.
But we can't find guideline in user-manual on how to merge the MLNX OFED modification into kernel tree, does
anyone know how to do that? Better in officially way :-P
Regards,
Michael Wang
Hi, I would like to virtualize the instance interface with infiniband following Neutron/ML2 - OpenStack, but i have a Qlogic switch. The mechanism driver are only for Huawei, Artista, Brocade, Cisco. How can I do?
thank you.
Let me check that for you.
Ophir.
Hi,
I have a question for you Ale . I've installed in my company OpenStack(Juno) with 5 compute node, 1 network node, 1 controller node and 1 storage node using CentOS 7.The compute node have infiniband. I use a qlogic infiniband switch. I would like to virtualize the instance with infiniband. What do you do to realize it? Have you follow this Neutron/ML2 - OpenStack ? thank you so much
Thanks Ophir for sharing the beta driver https://community.mellanox.com/docs/DOC-1412
I have installed the beta driver into ESXi 6.0. Both iSER and SRP shows up
The storage is Solaris 11.2. 2 x L5630 CPU, 24 GB RAM. 4 x SSD for L2ARC. 8 x 450GB 15K SAS drive (4 x mirror). HBA LSI 9207-8e. ConnectX-2 VPI 2.10.700 firmware
Test VM is 2 vCPU, 4 GB memory
iSER Throughput 1700 MB/s
iSER 4k random IO: 57682
For comparison.
IPoIB (on 1.8.2 driver): 547 MB/s
SRP: 2883 MB/s
iSER is still not as good as SRP but way better then standard IPoIB.
Thanks again for providing the beta driver!
Hi Vincenzo,
what do you mean for "virtualize the instance with infiniband"? Do you want to provide IB adapters to your instances via SR-IOV virtual functions? In the configuration I described above I have not set up SR-IOV virtual functions but I only use the Ethernet paravirtualization driver (eth_ipoib) on top of IPoIB devices. If you are interested in true Infiniband virtualization via SR-IOV virtual functions you should refer to these links:
Mellanox-Neutron-ML2 - OpenStack (see the Infiniband links)
Mellanox OFED Driver Installation and Configuration for SR-IOV
I didn't try it with Juno but last year I set up Openstack Havana with SR-IOV, so please feel free to contact me if you need help.
Thanks,
Ale
IS5022 is externally managed. I think in your case at least one switch needs to be manageable. But I might be wrong.
I'm install vSphere OFED 1.8.3 Beta driver yesterday.
iSER shows a good performance and reliability.
Single port test was show a good performance at 3.6GB/s throughput, but dual port wasn't.
Only 4.2GB/s. Because a PCIe 2.0 x8 slot's bottleneck...:)
But here is some qustions.
Q1. How can I change QD per LUN on iSER?
Q2. Whenever create Host Profile was failed on every ESXi 6 host with vSphere OFED 1.8.3.
Q3. What's your iSER target?
I'm using OmniOS now
When I prepared try CentOS 7 LIO iSER Target for VAAI support.
I found some workaround about Q2.
1. After Install vSphere OFED 1.8.3 and etc then configure all iSER configurations.
2. Disable loading the iSER driver and reboot the ESXi host.
esxcli system module set --enabled=false -m=ib_iser
* Don't use /opt/mellanox/bin/openibd.sh stop
If you excute this command then you'll get a blank vSwitch configuration in Host Profile.
Therefore you must attach IPoIB vnmic to that vSwitch every ESXi host...:(
3. Create the host profile and re-enable loading the iSER driver and reboot the ESXi host.
esxcli system module set --enabled=true -m=ib_iser
4. Apply host profile another ESXi host
5. Finalize iSER setup (iSER target, vmkport, etc.)
I'm search iSER vmhba327680, 327681 in /etc/vmware/esx.conf, but I can't find anywhere.
I found IPoIB vmnic (vmnic-ib0, ib1) only.
This driver is Beta phase and I think Mellanox will correct this problem with VMware...:)
These cards are really old, older than the first WinOFED driver. I don't think these will work on your OS. code 10 is a generic windows error on driver compatibility and can generate from various of reasons.
Hi,
Kernel 3.18 for what OS ? Ubuntu 14.04?
Hi! Because Infiniband fabric require Subnet Manager.
If you connect direct between each hosts, one of host must have a active SM.
If not IPoIB can link-up. IPoIB is a also ULP of Infiniband that require SM
too!
If you install a Ethernet driver, your HCA can link-up without SM.
But your HCA never shows a Infiniband's features.
2015년 4월 16일 목요일, vpatricks<community@mellanox.com>님이 작성한 메시지:
Mellanox Interconnect Community
5.5 & IB Dual Port Card card showing just a sinlge vmnic
reply from Patrick Schulz
in Technical Forums - View the full discussion
We will run Debian I suppose :-)