Hi.
I had a problem port priority 3 counters is not.
Reference is https://community.mellanox.com/docs/DOC-1414
What should we check
Thank you in advance!
pc1 - Switch - pc2
Switch firmware 3.4.2008
pc1 and 2 is Ububtu 14.04
Fimware 2.35.5100
Driver 3.1.-1.0.3
pc1
root@Clotho:~# ib_write_bw -R --report_gbits --port=12500 -D 10
************************************
* Waiting for client to connect... *
************************************
---------------------------------------------------------------------------------------
RDMA_Write BW Test
Dual-port : OFF Device : mlx4_0
Number of qps : 1 Transport type : IB
Connection type : RC Using SRQ : OFF
CQ Moderation : 100
Mtu : 1024[B]
Link type : Ethernet
Gid index : 0
Max inline data : 0[B]
rdma_cm QPs : ON
Data ex. method : rdma_cm
---------------------------------------------------------------------------------------
Waiting for client rdma_cm QP to connect
Please run the same command with the IB/RoCE interface IP
---------------------------------------------------------------------------------------
local address: LID 0000 QPN 0x025a PSN 0x86a3f8
GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:10:10
remote address: LID 0000 QPN 0x025a PSN 0x35cd7d
GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:10:20
---------------------------------------------------------------------------------------
#bytes #iterations BW peak[Gb/sec] BW average[Gb/sec] MsgRate[Mpps]
65536 417600 0.00 36.47 0.069568
---------------------------------------------------------------------------------------
root@Clotho:~# ethtool -S p1p1 | grep prio_3
rx_pause_prio_3: 0
rx_pause_duration_prio_3: 0
rx_pause_transition_prio_3: 0
tx_pause_prio_3: 0
tx_pause_duration_prio_3: 0
tx_pause_transition_prio_3: 0
rx_prio_3_packets: 0
rx_prio_3_bytes: 0
tx_prio_3_packets: 0
tx_prio_3_bytes: 0
root@Clotho:~# ./roce-check.sh
============================
pfcrx / pfctx parameters
============================
INTERFACE: mlx4_en
RX: 0x08
TX: 0x08
============================
VLAN parameters
============================
VLAN: p1p1.100
EGRESS priority mappings: 0:3 1:3 2:3 3:3 4:3 5:3 6:3 7:3
pc2.
ib_write_bw -R --report_gbits 192.168.10.10 --port=12500 -D 10
---------------------------------------------------------------------------------------
RDMA_Write BW Test
Dual-port : OFF Device : mlx4_0
Number of qps : 1 Transport type : IB
Connection type : RC Using SRQ : OFF
TX depth : 128
CQ Moderation : 100
Mtu : 1024[B]
Link type : Ethernet
Gid index : 0
Max inline data : 0[B]
rdma_cm QPs : ON
Data ex. method : rdma_cm
---------------------------------------------------------------------------------------
local address: LID 0000 QPN 0x025a PSN 0x35cd7d
GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:10:20
remote address: LID 0000 QPN 0x025a PSN 0x86a3f8
GID: 00:00:00:00:00:00:00:00:00:00:255:255:192:168:10:10
---------------------------------------------------------------------------------------
#bytes #iterations BW peak[Gb/sec] BW average[Gb/sec] MsgRate[Mpps]
Conflicting CPU frequency values detected: 2799.937000 != 1220.531000. CPU Frequency is not max.
65536 417600 0.00 36.47 0.069568
---------------------------------------------------------------------------------------
root@Aprotos:~# ethtool -S p1p1 | grep prio_3
rx_pause_prio_3: 0
rx_pause_duration_prio_3: 0
rx_pause_transition_prio_3: 0
tx_pause_prio_3: 0
tx_pause_duration_prio_3: 0
tx_pause_transition_prio_3: 0
rx_prio_3_packets: 0
rx_prio_3_bytes: 0
tx_prio_3_packets: 0
tx_prio_3_bytes: 0
root@Aprotos:~# ./roce-check.sh
============================
pfcrx / pfctx parameters
============================
INTERFACE: mlx4_en
RX: 0x08
TX: 0x08
============================
VLAN parameters
============================
VLAN: p1p1.100
EGRESS priority mappings: 0:3 1:3 2:3 3:3 4:3 5:3 6:3 7:3