Re: ConnectX-En 10G crash under load :-(
I have another PSOD last week, i have to pull all connectx2-en out of company servers. We only have 10G ethernet switch, therefore 1.6.1.2 is my only choice.I will try to reproduce this issue. Thank...
View ArticleRe: 40GbE optimization and bandwidth testing
Hi! Is there any chance you could try some kernel RAM disk instead of StarWinds (that is running in user mode as you may know)? Also, am I right in assumption that you are connecting to the disk via...
View ArticleRe: 40GbE optimization and bandwidth testing
bmac20 wrote: hii tried starwind on windows as iscsi server.. its quite bad may I ask you what exactly appeared to be bad for you in your StarWind experience?
View ArticleRe: Windows to Linux IB connections
I'm sorry for the lack of information. From my reading I understand that IPoIB is a viable option for both the Linux and Windows networking stacks. However the applications I would be developing...
View ArticleRe: ConnectX-En 10G crash under load :-(
Hi Dualamd, Please open a ticket with Mellanox support for looking into the PSOD. can you post the PSOD output here?
View ArticleRe: 40GbE optimization and bandwidth testing
Hi. I don't know if you're asking Bmac or me (the OP) but no, I'm not using iSCSI. As I already posted, a forum member on ServeTheHome was able to get 2GB/s using a 20Gbps ConnectX IB card from one...
View ArticleClik here to view.
GPUDirect
As a result of the NVIDIA co-development effort with Mellanox Technologies, Mellanox provides support for GPUDirect technology, that eliminates CPU bandwidth and latency bottlenecks using direct memory...
View ArticleGetting eIPoIB to work ?
OK, I've been trying to setup eIPoIB. I have my infiniband network up, ib0 is setup for ipoib I can see the new eth2 interface (virtual eIPoIB device) but nothing in the vifs, so I can't ping from...
View ArticleRe: Getting eIPoIB to work ?
ok thanks to a google with another 3 commands on each node I can now using the eipoib interfaces. the first command creates the ib0 sub interface in this case ib0.1 root@blade01:~# echo .1 >...
View ArticleRe: Getting eIPoIB to work ?
My question now is why wasn't the sub ib0.1 interface enslaving setup for me as the user manual says the below: "The IPoIB daemon (ipoibd) detects the new VIFs and creates a new IPoIB instances, as a...
View ArticleRe: 40GbE optimization and bandwidth testing
Hi renderfarmer, Can you open a Powershell window and enter: Get-SmbServerNetworkInterfaceI'm curious to know if Windows thinks that RDMA is working. I don't often read the Mellanox forums, so it might...
View ArticleRe: 40GbE optimization and bandwidth testing
Hi, dba. I just posted this on the STH forums but here it is for anyone that is interested here: PS C:\Users\Administrator> Get-SmbServerNetworkInterface Scope Name Interface Index RSS...
View ArticleRe: 40GbE optimization and bandwidth testing
Good news: You have RDMA-capable cards, which is no surprise. Do you get the same results when run on both the client machine and the server machine?
View ArticleRe: Getting eIPoIB to work ?
Hi drolfe,Indeed, the ipoib daemon (ipoibd) should create and enslave the ibX.Y interfaces automatically. No need for user interference. Please make sure that it's running.You can also try to edit...
View ArticleRe: GPUDirect
Hi justinclift,For sample code -in this stage- you'll need early access to the alpha drop.Please contact hpc@mellanox.com. Once the GA is ready, we'll provide the code as well as samples for utilizing...
View ArticleClik here to view.
Re: GPUDirect
Thanks Ali Ayoub. I'll probably just wait for the GA or something. Kind of curious, as I have some Nvidia gear around anyway, so was just wondering. Don't actually have a real use in mind for this at...
View ArticleRe: 40GbE optimization and bandwidth testing
fyia good guide for ipoibInfiniband HOWTO: Setting up a basic infiniband network
View ArticleRe: Getting eIPoIB to work ?
ipoibd is in the public beta is broken on ubuntu. I needed to hack it in order to make it run. Even when it is properly configured, the daemon immediately exits due to a check if the operating system...
View ArticleRe: Getting eIPoIB to work ?
Thanks for the info , I don't have access to my lab on the weekend but I'll have to check it out when back in the office. Do you have the details of what you changed on your ubuntu system ?
View ArticleRe: Getting eIPoIB to work ?
It was basically the initial distribution test, and then i removed the full paths in all of the calls to external commands.
View Article