[openib-general] netperf over SDP bug
Grant Grundler
iod00d at hp.com
Tue Sep 27 18:17:00 PDT 2005
Hi Michael,
I'm trying to collect a full set of netperf TCP_STREAM over SDP for
SVN r3547 on 2.6.13 kernel. But some netperf runs get no throughput.
Usually when sending 1k to 4k messages. The same netperf parameters
sing IPoIB seem to be working fine - just alot slower of course.
Summary of all netperf over SDP runs is appended.
Sample commandline that got < 1Mb/s throughput is:
LD_PRELOAD=/usr/local/lib/libsdp.so /usr/local/bin/netperf -p 12866 -l 60 -H 10.0.0.30 -t TCP_STREAM -T 1 -- -m 1024 -s 16384 -S 16384
I tried with some smaller -m parameters:
512 -> ~270-280 Mb/s
640 -> ~200-2100 Mb/s
768 -> ~30-50 Mb/s
896 -> ~2-6 Mb/s
CPU is essentially idle in the above 512-896 byte cases.
Anything obvious I should be looking for or worth trying?
thanks,
grant
#Recv Send Send
#Socket Socket Message Elapsed
#Size Size Size Time Throughput
#bytes bytes bytes secs. 10^6bits/sec
grundler <505>grep -h ' 60\.0. ' sdp*.out | sort -n -k 3
131072 131072 1 60.01 12.79
196608 196608 1 60.01 13.16
245760 245760 1 60.02 12.81
32768 32768 1 60.02 13.63
65536 65536 1 60.00 14.00
98304 98304 1 60.02 13.46
131072 131072 16 60.03 202.12
196608 196608 16 60.01 210.89
245760 245760 16 60.01 210.49
32768 32768 16 60.01 203.87
65536 65536 16 60.02 205.01
98304 98304 16 60.02 207.76
131072 131072 64 60.02 707.19
196608 196608 64 60.01 822.16
245760 245760 64 60.01 68.63
32768 32768 64 60.01 129.12
65536 65536 64 60.03 563.39
98304 98304 64 60.02 833.90
131072 131072 1024 60.01 0.06
196608 196608 1024 60.02 0.21
245760 245760 1024 60.01 0.28
32768 32768 1024 60.02 7.24
65536 65536 1024 60.01 0.06
98304 98304 1024 60.01 0.20
131072 131072 2048 60.02 0.03
196608 196608 2048 60.02 0.03
245760 245760 2048 60.01 0.03
32768 32768 2048 60.02 0.03
65536 65536 2048 60.01 0.03
98304 98304 2048 60.02 0.11
131072 131072 4000 60.02 0.04
196608 196608 4000 60.02 0.04
245760 245760 4000 60.01 0.04
32768 32768 4000 60.02 0.04
65536 65536 4000 60.02 0.04
98304 98304 4000 60.01 0.04
131072 131072 4096 60.02 0.03
196608 196608 4096 60.02 0.03
245760 245760 4096 60.02 0.03
32768 32768 4096 60.02 0.03
65536 65536 4096 60.02 0.03
98304 98304 4096 60.02 0.03
131072 131072 8192 60.02 5340.88
196608 196608 8192 60.02 5484.05
245760 245760 8192 60.02 5328.48
32768 32768 8192 60.02 5480.58
65536 65536 8192 60.02 5319.36
98304 98304 8192 60.01 5433.01
131072 131072 8197 60.01 5412.53
196608 196608 8197 60.01 5392.23
245760 245760 8197 60.02 5391.18
32768 32768 8197 60.01 5467.68
65536 65536 8197 60.01 5465.49
98304 98304 8197 60.01 5295.13
131072 131072 16384 60.01 5492.78
196608 196608 16384 60.02 0.05
245760 245760 16384 60.01 5487.60
32768 32768 16384 60.01 5507.06
65536 65536 16384 60.02 5497.21
98304 98304 16384 60.02 5494.97
131072 131072 49152 60.01 5711.59
196608 196608 49152 60.02 5708.24
245760 245760 49152 60.01 5710.23
32768 32768 49152 60.02 5657.29
65536 65536 49152 60.01 5710.62
98304 98304 49152 60.02 5711.56
131072 131072 49157 60.01 5693.26
196608 196608 49157 60.03 5685.55
245760 245760 49157 60.01 5691.51
32768 32768 49157 60.01 5653.52
65536 65536 49157 60.01 5690.49
98304 98304 49157 60.01 5693.11
131072 131072 57344 60.01 5528.27
196608 196608 57344 60.01 5629.15
245760 245760 57344 60.01 5626.02
32768 32768 57344 60.02 5544.92
65536 65536 57344 60.01 5627.32
98304 98304 57344 60.01 5628.52
131072 131072 65536 60.01 5674.38
196608 196608 65536 60.01 5674.19
245760 245760 65536 60.01 5672.49
32768 32768 65536 60.02 5619.26
65536 65536 65536 60.01 5673.84
98304 98304 65536 60.01 5675.05
131072 131072 131070 60.01 5550.89
196608 196608 131070 60.02 5549.08
245760 245760 131070 60.01 5548.43
32768 32768 131070 60.01 5550.42
65536 65536 131070 60.02 5489.22
98304 98304 131070 60.01 5550.11
131072 131072 131072 60.01 5554.28
196608 196608 131072 60.02 5553.87
245760 245760 131072 60.02 5554.01
32768 32768 131072 60.01 5567.14
65536 65536 131072 60.01 5458.83
98304 98304 131072 60.01 5554.56
131072 131072 131079 60.03 5428.02
196608 196608 131079 60.02 5361.43
245760 245760 131079 60.01 5437.48
32768 32768 131079 60.01 5426.85
65536 65536 131079 60.01 5432.93
98304 98304 131079 60.02 5344.43
More information about the general
mailing list