Quantcast
Channel: Mellanox Interconnect Community: Message List
Viewing all 6226 articles
Browse latest View live
↧

IB link aggregation between Mellanox switches?

November 8, 2017, 11:49 am
$
0
0

I have a SX6018T switch (18-port FDR10 40Gbps), and I'm considering getting a SX6036F (36-port FDR 56Gbps). Since I have a few 10GBE clients, and an IB/Ethernet Gateway license on the SX6018T, I'd like to keep using that in addition to the new switch, both for 10GBE clients and for FDR10 IB clients (the Ethernet gateway license for the 6036 is quite expensive).

 

The two switches will be right next to each other in the same rack, and I'm planning to use a copper cable to connect them. That will be a 40Gbps uplink, and I'd be interested in getting a bit more bandwidth between them, so I guess what I'm looking for is link aggregation between two ports, so I could get 80Gbps instead. However, I haven't found a lot of information on this (Ethernet link aggregation is documented in various places, but not IB). Is this supported? Automatic? How do I set this up? Can I (theoretically) aggregate more than two ports too?

↧
Search

Reserved VLAN Ranges

November 8, 2017, 12:11 pm
$
0
0

Does Mellanox have a fixed range of VLANs which are reserved for specific functions? Something similar to Cisco?

↧
↧

Re: MLAG interfaces are active-active ?

November 8, 2017, 1:00 pm
$
0
0

What is the cumulative bandwidth available on a MLAG in this scenario? Is there a way to verify ?

↧

Re: Reserved VLAN Ranges

November 8, 2017, 1:59 pm
$
0
0

With MLNX-OS You can use any vlan value between 1 to 4094

↧

Re: How to couple Connectx with FPGA?

November 8, 2017, 1:59 pm
$
0
0

Crossfield Technology LLC (www.crossfieldtech.com) has an Instrumentation Gateway that connects a Mellanox ConnectX-3 to a Xilinx Virtex 7 through a PCIe switch.  We implement OFED under embedded Linux running on a NXP QorIQ P4040 also connected to the PCIe switch, and we use FPGADirect to perform RDMA transactions directly into FPGA memory similar to GPUDirect.  The Instrumentation Gateway implements dual VITA 57.1 FMC slots for interfacing to data acquisition FMC modules.  We are planning to migrate this design to Ultrascale+ in the future.  Please contact info@crossfieldtech.com if you have any questions.

 

Thanks,

Brett

↧
↧

Can I set the 40G speed of the mellanox SN2100？

November 9, 2017, 12:25 am
$
0
0

Hello,

  I have a Mellanox SN2100  switch for my DC and bought it in July, a few days ago, I find I can't use the 40G optical  transceiver on all the ports，the datasheet says it can support the 40G cables and optical transceivers.  The system is cumulus linux, when I use the command of " netshow interface",it shows  the speed of all ports are 100G,Also,the 100G optical transceivers will be ok,but the 40G can't link with the other one,even the cables,So I'm so puzzled.Can I set the  40G speed of the mellabox SN2100?  if yes,can you offer it? or are there some links I can  find it? your helps will be appreciated. Thanks so much!

SN2100.png

↧

Re: RHEL/CentOS update Inbox driver / howto compile

November 9, 2017, 12:47 am
$
0
0

Hello, idk about 4.12.4 kernel, but we using custom RT kernel and using for install:

./mlnxofedinstall --add-kernel-support --skip-repo --wihout-32bit #you interesting in --add-kernel-support option

also you can try download ofed for the last fedora and modify some files to use it. but idk would it work or not.

↧

Re: RHEL/CentOS update Inbox driver / howto compile

November 9, 2017, 2:39 am
$
0
0

Hi
does not work either ...

 

# ./mlnxofedinstall --add-kernel-support --skip-repo

Current operation system is not supported!

 

Will try with OFED for fedora later on

↧
Search

Re: RHEL/CentOS update Inbox driver / howto compile

November 9, 2017, 3:20 am
$
0
0

Hi

which centos you use? version?

you should change your mlnxofedinstall file for it accepting "wrong" OS.

↧
↧

mlx4_core : Missing UAR, aborting

November 9, 2017, 9:35 am
$
0
0

OS: Ubuntu 16.04.3 LTS

 

$ lspci | grep Mellanox

01:00.0 Ethernet controller: Mellanox Technologies MT27520 Family [ConnectX-3 Pro]

 

$ mstflint -d 01:00.0 q

Image type:        FS2
FW Version:        2.42.5000
FW Release Date:   5.9.2017
Product Version:   02.42.50.00
Rom Info:          type=PXE version=3.4.752 devid=4103
Device ID:         4103
PSID:              MT_2340111023

 

I have installed all drivers, ran  '/etc/init.d/mlnx-en.d retstart' , got :

Unloading NIC driver: [ OK ]

Loading NIC driver:     [ OK ]

 

BUT can't see mellanox interface (ifconfig -a)

when I type now 'dmesg | grep mlx' , I get:

[0.991278] mlx_compat: loading out-of-tree module taints kernel.
[0.991286] mlx_compat: module verification failed: signature and/or required key missing - tainting kernel
[0.992456] mlx4_core: Mellanox ConnectX core driver v4.1-1.0.2 (27 Jun 2017)
[0.992479] mlx4_core: Initializing 0000:01:00.0
[0.992621] mlx4_core 0000:01:00.0: Missing UAR, aborting

 

What is the problem here?

 

P.S. I had no problem with this NIC on my computer, when used Ubuntu 14.04 LTS

↧

Mellanox IS 5030 Licenses

November 9, 2017, 11:14 pm
$
0
0

Hi,

 

I wonder if anyone can help me.  I inherited a couple of Mellanox IS 5030 switches.  I was able to log into the Web interface and it showed it had no licenses.  I also don't see any configuration for VLAN and multicast IGMP support.  Those are really the main functions I need.  Please help answer the following questions:

 

1) Are those IS 5030 switches upgradable to support VLAN and multicast?  If so, what license(s) do I need and where can I get some licenses right now?

 

2) Are VLAN and multicast IGMP support configure via the Web interface or CLI only?

 

3) How do I upgrade the firmware to the latest?  Website is not clear on the step by step instruction.  Where can I download the latest firmware and upgrade instructions for these switches?

 

4) Can these switches be upgraded to 56 Gbps?

 

5) Are these switches fully compatible with latest Mellanox switches?

 

Thanks for any help in advance.

↧

backward compatibility FDR vs DDR

November 10, 2017, 1:55 am
$
0
0

I'm end user of big IB infrastructure and we are trying to gain new experiences in this field in our group. We have access to  http://www.mellanox.com/page/products_dyn?product_family=50&menu_section=49/ old DDR switch and we want to use it with some new FDR IB (or EDR) cards (ConnectX® series VPI QSFP28). My question is : Is it possible to use FDR(EDR) card with DDR switch on DDR speed with QSFP28 (FDR/EDR) cable (in future we want to replace switch but first we want to gain some experiences). Is it better copper or optical cable? Thanks for your reply.

↧

Does anyone have or know about the documentation of a Voltaire Vantage 6048?.

November 10, 2017, 11:21 am
$
0
0

I have searched for hours in google and I do not find anything, if someone has used it and has information about it I will appreciate it.

 

Thank you

↧
↧

A few questions about ConnectX-3/PRO, SR-IOV, Cisco Nexus 3048

November 12, 2017, 8:22 am
$
0
0

Hi,

 

I have a few questions, is preparing for the research environment (VMware ESXi 6.5, VM's - Centos):

1. What is the difference between ConnectX-3 and ConnectX-3 PRO?(RoCE v2?)

2. What is the maximum number of virtual functions per port for ConnectX-3 and ConnectX-3 PRO ?  (126 VFs ? - https://community.mellanox.com/docs/DOC-2368#jive_content_id_Overview )

3. Is there a correlation between the number of cores / threads  and the number of VFs ? For example: Dell PowerEdge R710 12 cores / 24 threads, 96GB RAM.

4. I want to configure RDMA (RoCE v1 / v2) on Cisco NEXUS 3048TP-1GE.Need to enable PFC on peer-link ports (running vPC) or just port between card and swich?

 

Best Regards,

Robert

↧

100GBase-LR4 supported Ethernet card

November 13, 2017, 12:22 pm
$
0
0

Hi,

I was told Mellanox ConnectX-5 will support 100GBase-LR4 transceivers, but I was not able to fine an exact model of 100G Ethernet card with ConnectX-5 that will support LR4 transceivers. Anyone could help me to find a PCIE 100GE card that supports 100GBase-LR4? Or, is there any datasheet mentioning that CX-5 supporting 100GBase-LR4?

 

thanks,

Peter

↧
Search

Re: Mellanox IS 5030 Licenses

November 13, 2017, 5:49 pm
$
0
0

Hi!

I used Mellanox IS5035 some years ago.

Here are some answers.

 

1) Are those IS 5030 switches upgradable to support VLAN and multicast?  If so, what license(s) do I need and where can I get some licenses right now?

- No : This is a Infiniband switch, not Ethernet switch.

 

2) Are VLAN and multicast IGMP support configure via the Web interface or CLI only?

- No : Infiniband switch can support IB partition only.

 

3) How do I upgrade the firmware to the latest?  Website is not clear on the step by step instruction.  Where can I download the latest firmware and upgrade instructions for these switches?

- If you hava a contract you can update firmware via Mellanox support.

 

4) Can these switches be upgraded to 56 Gbps?

- No : You must change your switch to FDR14 or above one.

 

5) Are these switches fully compatible with latest Mellanox switches?

- Yes : IB specification has a backward compatibility.

 

BR,

Jae-Hoon Choi

↧

Re: OL7.4 Mellanox OFED

November 13, 2017, 5:54 pm
$
0
0

MLNX_OFED 4.2 supported OEL7.3, BUT no support UEK?

 

thks

↧
↧

How to find out if the fabric is ready to IB communication after a switch reboot

November 13, 2017, 8:19 pm
$
0
0

I'm currently developing a script to automate a IB switch reboot (reload). Though I was able to trigger a switch reboot easily I don't know a way to find out if the switch is ready for normal operation.

I have been using the time  which I can issue an enable through CLI. will that be enough to identify the switch is ready for normal operations?

↧

Mellanox ConnectX-3 Disable RDMA

November 13, 2017, 11:08 pm
$
0
0

Hi,

 

Is it possible to use Mellanox ConnectX as a native Ethernet card (without RDMA) ?

 

Thanks

↧

OFED Github repo deleted?

November 14, 2017, 8:05 am
↧
Viewing all 6226 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>