[Users] Performance issue with FDR & Ubuntu

[German Anders]

Hi all,

Is there anyone around that is using IB FDR and running an iperf between
two hosts on the same net, are getting more than 24Gbits/sec? I'm running
in an Ubuntu server and I'm not able to get more than that, also I've
already try changing the mode from datagram to connected, connected is
working way better, and also changed and try many different MTUs.

# mlnx_tune -r -c

Mellanox Technologies - System Report

Operation System Status

*UBUNTU14.043.19.0-25-generic*

CPU Status
Intel Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz Ivy Bridge
OK: Frequency 3000.156MHz

Hyper Threading Status
ACTIVE

IRQ Balancer Status
INACTIVE

Driver Status
*OK: MLNX_OFED_LINUX-3.1-1.0.3 (OFED-3.1-1.0.3)*

ConnectX-3 Device Status on PCI 04:00.0
FW version 2.35.5100
OK: PCI Width x8
OK: PCI Speed 8GT/s
PCI Max Payload Size 256
PCI Max Read Request 512
Local CPUs list [0, 1, 2, 3, 4, 5, 6, 7, 16, 17, 18, 19, 20, 21, 22, 23]

ib0 (Port 1) Status
Link Type ib
OK: Link status Up
MTU 65520

ib1 (Port 2) Status
Link Type ib
OK: Link status Up
MTU 65520


Can anyone share some perf values and config tips in order to get the most
on this? I know that a lot will depend on the OS configuration, since if I
run a ib_send_bw I almost get 6Gb/s.

Thanks in advance,

Best,

*German*
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/users/attachments/20151222/1477bc8d/attachment.html>