Re: XenServer support
This is in the prod version. When I first attempted the install it listed along list of packages that were missing. I installed them by modifying therepo list and using Yum. Among these were several...
View ArticleRe: XenServer support
Here is a better question. When the install is complete on the DDK VM doesthe process create an rpm that I can install on the production version? This is my first forray into the infiniband world. We...
View ArticleRe: multiport IB card pros
Please correct me if I am wrong. With PCIE 2 x 8 card, isn't the max throughput is 32 Gbit/s? Is that going to be better to use two 1 port card instead of one dual ports card for better performance?
View ArticleRe: multiport IB card pros
Good question. For example MHJH29-XTC Dual 4X 40Gb/s InfiniBand has PCIe x8 2.0 5.0GT/s (4 GB/s) so how will one be able to push 2*40Gb/s thru it? A PCIe 3.0 x8 or 2.0 x16 might be able to handle such...
View ArticleRe: XenServer support
Thank you for the advice! The cards and switches we picked up are all DDR but it seems we would stillbe taking a step backwards until infiniband is natively supported in thexenserver kernel. Thank you...
View ArticleRe: multiport IB card pros
Let me try to explain PCI Generations, lane width and the cards as well. There are three components here:1. PCIe Generation, lane width,2. IB speed- QDR/FDR etc3. Encoding schemes 1. PCI Gen 2 speed...
View ArticleRe: multiport IB card pros
There is no way to push 80Gb/s on one single PCIe Gen 2x8 slot. This is the slot limitation. See my detailed explanation below for real world BW.
View ArticleRe: multiport IB card pros
For QDR with 2012 R2 RDMA, I have seem result close to 3200 MB/s. Is that means we can overcome the PCIE limitations?
View ArticleRe: multiport IB card pros
Thank you se-rulez for explaining this. The reality does not look so brilliant as the commonly used figures.20Gbps * 0.8 (DDR overhead) * 0.8 (PCI<=2.0 overhead) = 12.8 Gbit40Gbps * 0.8 (QDR...
View ArticleRe: multiport IB card pros
Remember that this limitation is from server to switch and is a function of the PCI capabilities rather than Infiniband protocol.Is a dual port ConnectX-3 (PCI 3.0) on the storage server my option for...
View ArticleRe: multiport IB card pros
No, that works out exactly to the number the calculations arrived at. 3200*8= 25600 Mbps or 25.6Gbps for QDR
View ArticleRe: Link up delay above QDR switches..
logical... does that mean:"no issues with physical link. it comes up as expected. but the ZFS SRPT connection takes time..." right? If yes, on the very basic level - how long until the server gets LID...
View ArticleRDMA WRITE target buffer updation.
Hi all, I am writing RDMA_WRITE latency(Round Trip Latency) application using OFED user verbs and kernel verbs. Since, in RDMA_WRITE, no work completion is generated on res-ponder side.I am using...
View ArticleRe: vSphere 5.1 U1 IPoIB VLAN support
In Windows environment, there is a limit with one partition/port. Just wondering how you were having mutiple partitions since I saw you list CSV/LM/HB/iSCSI?
View ArticleIs it 2015 already?
Mellanox OFED for Linux Release NotesRev 2.1-1.0.0Last Modified: 15 January, 2015
View ArticleDriving a 100 Gigabit Network with OpenStack
Here is a good blog post testing Mellanox adapters in OpenStack environment. Buried Lede: Driving a 100 Gigabit Network with OpenStack
View ArticleRe: Link up delay above QDR switches..
Hi! yairi...:)SM is embedded in Voltaire 4036 QDR switch. Major problem is your vSphere SRP Initiator. This driver doesn't disconnect (logout) from ZFS SRPT when ESXi host reboot everytimes. Frankly...
View ArticleRe: Upgrading 4036, media full
That's a good news....:) I'm struggled migration of Exchange Server 2003 to 2013 last week. I'm also experienced some problem that update 4036 firmware 2.x to 3.0. That's a final mountain for latest...
View ArticleRe: Scientific Linux 6.4 errors with mlnxofedinstall & mlnx_add_kernel_support
Update: There is a new ISO & TGZ, MLNX_OFED_LINUX-2.1-1.0.0-rhel6.5-x86_64 This ISO will install on CentOS and Scientific Linux with the latest kernel update, 431 Although I have discovered...
View Article