Thought I would add my question here as well as I'm having the same issues:
I just updated to MLNX_OFED_LINUX-3.4-1.0.0.0 today (was using 3.3) and I can't get ibdump to work on my ConnectX-4 Lx card.
Are the ConnectX-4 cards going to be supported by ibdump? Any pointers/suggestions would be appreciated!
Tcpdump doesn't seem to correctly decode RoCE traffic - well, it doesn't decode it like this post shows: https://community.mellanox.com/docs/DOC-2416
This is what I see when I do tcpdump:
root@ceb-ubu14:~# tcpdump -i eth2 -vv > ~/rdma_traffic.txt
10:51:15.571909 24:8a:07:11:4f:91 (oui Unknown) > 24:8a:07:0d:d6:d0 (oui Unknown), ethertype Unknown (0x8915), length 334:
0x0000: 6000 0000 0118 1b01 0000 0000 0000 0000 `...............
0x0010: 0000 ffff 0c0c 0c02 0000 0000 0000 0000 ................
0x0020: 0000 ffff 0c0c 0c01 6440 ffff 0000 0001 ........d@......
0x0030: 0000 056e 8001 0000 0000 0001 0107 0203 ...n............
0x0040: 0000 0000 0000 0004 34ed 641e 0010 0000 ........4.d.....
0x0050: 0000 0000 1e64 ed34 0000 0000 0000 0000 .....d.4........
0x0060: 0106 4853 248a 0703 0011 4f91 0000 0000 ..HS$.....O.....
0x0070: 0000 0000 0002 7900 0000 0000 0000 00a0 ......y.........
0x0080: 79e8 c5a7 ffff 37f0 0000 0000 0000 0000 y.....7.........
0x0090: 0000 0000 0000 ffff 0c0c 0c02 0000 0000 ................
0x00a0: 0000 0000 0000 ffff 0c0c 0c01 0000 0003 ................
0x00b0: 0001 0898 0000 0000 0000 0000 0000 0000 ................
0x00c0: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x00d0: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x00e0: 0040 c1ef 0000 0000 0000 0000 0000 0000 .@..............
0x00f0: 0c0c 0c02 0000 0000 0000 0000 0000 0000 ................
0x0100: 0c0c 0c01 0000 0000 0000 0000 0000 0000 ................
0x0110: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0120: 0000 0000 0000 0000 0000 0000 0000 0000 ................
0x0130: 0000 0000 0000 0000 0000 0000 640c f1db ............d...
10:51:15.580920 24:8a:07:0d:d6:d0 (oui Unknown) > 24:8a:07:11:4f:91 (oui Unknown), ethertype Unknown (0x8915), length 334:
...
My Setup:
root@ceb-ubu14:~# uname -a
Linux ceb-ubu14 4.4.0-36-generic #55~14.04.1-Ubuntu SMP Fri Aug 12 11:49:30 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
root@ceb-ubu14:~# ibdev2netdev
mlx5_0 port 1 ==> eth2 (Up)
root@ceb-ubu14:~# ifconfig eth2
eth2 Link encap:Ethernet HWaddr 24:8a:07:0d:d6:d0
inet addr:12.12.12.1 Bcast:12.12.12.255 Mask:255.255.255.0
inet6 addr: fe80::268a:7ff:fe0d:d6d0/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:10 errors:0 dropped:0 overruns:0 frame:0
TX packets:71 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:1237 (1.2 KB) TX bytes:10660 (10.6 KB)
root@ceb-ubu14:~# ethtool -i eth2
driver: mlx5_core
version: 3.4-1.0.0 (25 Sep 2016)
firmware-version: 14.16.1006
bus-info: 0000:05:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: no
supports-register-dump: no
supports-priv-flags: yes
root@ceb-ubu14:~# ethtool --show-priv-flags eth2
Private flags for eth2:
hw_lro : on
sniffer : on
dcbx_handle_by_fw : off
qos_with_dcbx_by_fw: off
rx_cqe_moder : off
root@ceb-ubu14:~# ibdump -d mlx5_0
Initiating resources ...
searching for IB devices in host
Port active_mtu=1024
MR was registered with addr=0x16a7000, lkey=0xbf82, rkey=0xbf82, flags=0x1
------------------------------------------------
Device : "mlx5_0"
Physical port : 1
Link layer : Ethernet
Dump file : sniffer.pcap
Sniffer WQEs (max burst size) : 4096
------------------------------------------------
Failed to set port sniffer1: command interface bad param
Thanks,
Curt