[openfabrics-ewg] IPoIB/SDP performance graphs for PCI-E RHEL4 U2 i686 Dell PE1850
Matt L. Leininger
mlleini at ca.sandia.gov
Thu Mar 30 10:23:14 PST 2006
On Wed, 2006-03-29 at 23:30 -0800, Scott Weitzenkamp (sweitzen) wrote:
> We've never been able to get very good IPoIB throughput on these
> systems (dual 3.0 GHz EMT64 CPUs). SDP performance seems very good,
> though.
>
> We're using LionCub Rev C HCAs.
I've attached my data for IPoIB performance for a variety of kernels.
>
> To summarize:
>
> min SDP latency: 26 usec
> max SDP throughput: 7.2 Gb/sec
> min IPoIB latency: 32 usec
> max IPoIB throughput: 1.7 Gb/sec
IPoIB throughput looks really low. Are you sure you have the PCIe HCA
in the PCIe 8X slot? I've seen poor throughput on the 1850's when you
have the HCA on the PCIe 4X slot.
- Matt
>
> Scott
> email message attachment
> > -------- Forwarded Message --------
> > From: Scott Weitzenkamp (sweitzen) <sweitzen at cisco.com>
> > To: Scott Weitzenkamp (sweitzen) <sweitzen at cisco.com>
> > Subject: Chassis TopspinOS-2.5.0 and Host IBED Test Results - Total:
> > 15; Pass 9; Fail: 1; Skip: 5
> > Date: Tue, 28 Mar 2006 10:31:58 -0800
> >
> >
> >
> > Protest Run Results
> >
> > Chassis Branch: TopspinOS-2.5.0
> > Chassis Build: build251
> > IB Hosts: svbu-qa1850-1 svbu-qa1850-2
> > IB Hosts OS: openib openib
> > Host Branch: IBED
> > Host Build: buildrc2
> > Topology: /data/home/scott/cluster_switch.main/qa/tests/smoke/Pb7.topo
> > Logs: /data/home/scott/builds/TopspinOS-2.5.0/build251/protest/Pb7/032806_092425
> > Logs URL:
> > http://svbu-borg.cisco.com/~releng/data/home/scott/builds/TopspinOS-2.5.0/build251/protest/Pb7/032806_092425
> >
> >
> > Scenario file: Netperf2Hosts.scen
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 1 Bytes
> > Throughput: 1.69 Mbits/sec
> > Transactions Per Second: 211250.00
> > Client CPU Usage: 59.44%
> > Server CPU Usage: 41.31%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1429: 3580: 1801132: 3726221: 65373: 111088: 131126:
> > 89377: 123308: 47340
> > TEN_USEC : 0: 249551: 3390: 65: 33: 32: 5: 5:
> > 2: 0
> > HUNDRED_USEC : 0: 2: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 6353059
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 2 Bytes
> > Throughput: 3.39 Mbits/sec
> > Transactions Per Second: 211875.00
> > Client CPU Usage: 60.12%
> > Server CPU Usage: 41.68%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1467: 3530: 1818158: 3709742: 65172: 114730: 129779:
> > 87955: 118142: 48712
> > TEN_USEC : 0: 251100: 3874: 92: 42: 43: 8: 4:
> > 2: 4
> > HUNDRED_USEC : 0: 17: 1: 0: 0: 0: 1: 1:
> > 2: 1
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 6352579
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 4 Bytes
> > Throughput: 6.65 Mbits/sec
> > Transactions Per Second: 207812.50
> > Client CPU Usage: 58.96%
> > Server CPU Usage: 41.68%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1072: 3350: 1413783: 3981313: 72353: 107013: 125753:
> > 92119: 107119: 59092
> > TEN_USEC : 0: 271790: 3701: 59: 32: 33: 7: 7:
> > 3: 1
> > HUNDRED_USEC : 0: 4: 1: 0: 0: 1: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 6238606
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 8 Bytes
> > Throughput: 13.48 Mbits/sec
> > Transactions Per Second: 210625.00
> > Client CPU Usage: 59.44%
> > Server CPU Usage: 41.48%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1343: 3337: 1704464: 3783969: 63760: 113136: 132428:
> > 88706: 114000: 52924
> > TEN_USEC : 0: 256446: 3603: 78: 55: 49: 9: 5:
> > 2: 2
> > HUNDRED_USEC : 0: 14: 1: 0: 0: 0: 0: 2:
> > 0: 1
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 6318334
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 16 Bytes
> > Throughput: 26.93 Mbits/sec
> > Transactions Per Second: 210390.62
> > Client CPU Usage: 58.87%
> > Server CPU Usage: 41.36%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1364: 3510: 1653763: 3842019: 67736: 106184: 124928:
> > 86686: 116393: 51734
> > TEN_USEC : 0: 255041: 3712: 82: 50: 38: 7: 4:
> > 3: 1
> > HUNDRED_USEC : 0: 12: 0: 0: 0: 0: 1: 3:
> > 0: 1
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 6313272
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 32 Bytes
> > Throughput: 53.71 Mbits/sec
> > Transactions Per Second: 209804.69
> > Client CPU Usage: 59.39%
> > Server CPU Usage: 41.39%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1267: 3403: 1604459: 3863032: 78319: 112351: 124566:
> > 88437: 113106: 54205
> > TEN_USEC : 0: 248769: 3625: 101: 46: 47: 8: 3:
> > 0: 1
> > HUNDRED_USEC : 0: 15: 0: 0: 0: 0: 0: 2:
> > 1: 1
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 6295764
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 64 Bytes
> > Throughput: 107.15 Mbits/sec
> > Transactions Per Second: 209277.34
> > Client CPU Usage: 58.39%
> > Server CPU Usage: 41.60%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1281: 3400: 1531488: 3923007: 82964: 103078: 118255:
> > 88823: 113603: 52507
> > TEN_USEC : 0: 256915: 4117: 70: 42: 36: 14: 5:
> > 0: 2
> > HUNDRED_USEC : 0: 12: 0: 0: 0: 0: 2: 1:
> > 1: 1
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 6279624
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 128 Bytes
> > Throughput: 211.76 Mbits/sec
> > Transactions Per Second: 206796.88
> > Client CPU Usage: 58.84%
> > Server CPU Usage: 41.68%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1075: 3132: 1350939: 3991296: 109369: 99393: 124286:
> > 95902: 103881: 55857
> > TEN_USEC : 0: 264929: 4649: 86: 42: 50: 8: 5:
> > 2: 0
> > HUNDRED_USEC : 0: 16: 0: 0: 0: 0: 1: 2:
> > 1: 1
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 6204922
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 256 Bytes
> > Throughput: 406.19 Mbits/sec
> > Transactions Per Second: 198334.96
> > Client CPU Usage: 59.16%
> > Server CPU Usage: 41.98%
> > Average Latency: 5.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1045: 2877: 872417: 3798081: 537624: 73290: 92262:
> > 86699: 103777: 65267
> > TEN_USEC : 0: 311156: 6482: 104: 39: 28: 9: 2:
> > 2: 3
> > HUNDRED_USEC : 0: 6: 1: 0: 0: 1: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 5951172
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 512 Bytes
> > Throughput: 796.12 Mbits/sec
> > Transactions Per Second: 194365.23
> > Client CPU Usage: 58.58%
> > Server CPU Usage: 41.61%
> > Average Latency: 5.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 757: 2666: 623740: 3792428: 688974: 63564: 89300:
> > 89378: 95724: 74757
> > TEN_USEC : 0: 302772: 8853: 105: 49: 52: 9: 3:
> > 3: 1
> > HUNDRED_USEC : 0: 15: 1: 0: 0: 0: 1: 2:
> > 1: 2
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 5833157
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 1024 Bytes
> > Throughput: 1527.45 Mbits/sec
> > Transactions Per Second: 186456.30
> > Client CPU Usage: 58.41%
> > Server CPU Usage: 42.71%
> > Average Latency: 5.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 541: 2631: 443650: 3387936: 1079669: 39998: 78817:
> > 86019: 67381: 81721
> > TEN_USEC : 0: 294238: 31632: 202: 65: 52: 16: 6:
> > 9: 3
> > HUNDRED_USEC : 0: 5: 1: 0: 0: 1: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 2: 2: 0: 0: 1: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 5594598
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 2048 Bytes
> > Throughput: 2734.36 Mbits/sec
> > Transactions Per Second: 166892.09
> > Client CPU Usage: 58.26%
> > Server CPU Usage: 45.21%
> > Average Latency: 5.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 124: 1340: 95967: 1860562: 2155143: 224542: 50572:
> > 99103: 66502: 67403
> > TEN_USEC : 0: 323390: 62517: 333: 49: 48: 17: 5:
> > 5: 2
> > HUNDRED_USEC : 0: 16: 1: 0: 0: 0: 0: 1:
> > 2: 3
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 1: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 5007648
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 4096 Bytes
> > Throughput: 4489.29 Mbits/sec
> > Transactions Per Second: 137002.26
> > Client CPU Usage: 55.88%
> > Server CPU Usage: 45.86%
> > Average Latency: 7.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 75: 959: 2029: 678000: 1527505: 828611: 423430:
> > 161574: 106401: 30767
> > TEN_USEC : 0: 116232: 222718: 12330: 194: 52: 28: 14:
> > 7: 5
> > HUNDRED_USEC : 0: 23: 3: 0: 0: 1: 1: 3:
> > 2: 1
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 4110965
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 8192 Bytes
> > Throughput: 5472.24 Mbits/sec
> > Transactions Per Second: 83499.76
> > Client CPU Usage: 57.81%
> > Server CPU Usage: 47.18%
> > Average Latency: 11.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 5: 177: 564: 107231: 467630: 370967:
> > 323937: 179675: 226400
> > TEN_USEC : 0: 488757: 209730: 115716: 14183: 277: 49:
> > 41: 16: 11
> > HUNDRED_USEC : 0: 33: 2: 0: 0: 0: 0: 6:
> > 1: 1
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 2505409
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 16384 Bytes
> > Throughput: 6514.62 Mbits/sec
> > Transactions Per Second: 49702.61
> > Client CPU Usage: 53.19%
> > Server CPU Usage: 49.31%
> > Average Latency: 20.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 38: 171: 627: 169116:
> > 87414: 45168
> > TEN_USEC : 0: 647216: 267422: 199193: 63226: 10638: 894:
> > 101: 29: 22
> > HUNDRED_USEC : 0: 56: 2: 5: 0: 0: 1: 1:
> > 1: 1
> > UNIT_MSEC : 0: 2: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 1491344
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 32768 Bytes
> > Throughput: 7089.57 Mbits/sec
> > Transactions Per Second: 27044.56
> > Client CPU Usage: 51.46%
> > Server CPU Usage: 50.81%
> > Average Latency: 36.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 9
> > TEN_USEC : 0: 123793: 176361: 172605: 192871: 113952: 25354:
> > 3853: 551: 127
> > HUNDRED_USEC : 0: 1998: 13: 7: 0: 0: 0: 0:
> > 4: 2
> > UNIT_MSEC : 0: 3: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 811503
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 65536 Bytes
> > Throughput: 7139.25 Mbits/sec
> > Transactions Per Second: 13617.04
> > Client CPU Usage: 49.24%
> > Server CPU Usage: 50.63%
> > Average Latency: 73.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 633: 17340: 13115: 47904: 170791:
> > 81591: 34231: 12930
> > HUNDRED_USEC : 0: 29969: 71: 5: 2: 0: 0: 2:
> > 1: 0
> > UNIT_MSEC : 0: 2: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 408587
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 131072 Bytes
> > Throughput: 7209.77 Mbits/sec
> > Transactions Per Second: 6875.77
> > Client CPU Usage: 49.09%
> > Server CPU Usage: 50.43%
> > Average Latency: 145.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 1: 5:
> > 12: 168
> > HUNDRED_USEC : 0: 187800: 18295: 12: 4: 1: 0: 0:
> > 1: 2
> > UNIT_MSEC : 0: 6: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 206307
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 262144 Bytes
> > Throughput: 7132.63 Mbits/sec
> > Transactions Per Second: 3401.10
> > Client CPU Usage: 47.68%
> > Server CPU Usage: 50.11%
> > Average Latency: 293.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 36: 56429: 45513: 60: 4: 3: 0:
> > 0: 2
> > UNIT_MSEC : 0: 4: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 102051
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 524288 Bytes
> > Throughput: 7160.12 Mbits/sec
> > Transactions Per Second: 1707.11
> > Client CPU Usage: 47.33%
> > Server CPU Usage: 50.31%
> > Average Latency: 585.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 472: 36223: 14451: 62:
> > 6: 1
> > UNIT_MSEC : 0: 8: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 51223
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 1048576 Bytes
> > Throughput: 7182.07 Mbits/sec
> > Transactions Per Second: 856.17
> > Client CPU Usage: 47.98%
> > Server CPU Usage: 50.46%
> > Average Latency: 1167.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 25685: 3: 0: 0: 1: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 25689
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 2097152 Bytes
> > Throughput: 7189.94 Mbits/sec
> > Transactions Per Second: 428.55
> > Client CPU Usage: 47.29%
> > Server CPU Usage: 51.39%
> > Average Latency: 2332.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 12850: 8: 0: 1: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 12859
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 4194304 Bytes
> > Throughput: 7196.26 Mbits/sec
> > Transactions Per Second: 214.47
> > Client CPU Usage: 47.31%
> > Server CPU Usage: 50.76%
> > Average Latency: 4662.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 6425: 10: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 6435
> >
> > IP.Performance.Netperf.SDP2SDP.TCP_STREAM --> PASS
> > ###TEST-D: TCP_RR - time out while waiting for prompt after running
> > netperf
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 1,1
> > Throughput: 0.31/0.31 Mbits/sec
> > Transactions Per Second: 19074.74
> > Client CPU Usage: 20.50%
> > Server CPU Usage: 18.68%
> > Average Latency: 26.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 1: 1: 49574: 516912: 5488: 178:
> > 94: 41
> > HUNDRED_USEC : 0: 49: 4: 1: 0: 0: 0: 0:
> > 1: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 572345
> >
> > ###TEST-D: TCP_RR - time out while waiting for prompt after running
> > netperf
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 2,2
> > Throughput: 0.61/0.61 Mbits/sec
> > Transactions Per Second: 19109.44
> > Client CPU Usage: 20.82%
> > Server CPU Usage: 18.97%
> > Average Latency: 26.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 2: 59249: 508394: 5366: 193:
> > 106: 29
> > HUNDRED_USEC : 0: 47: 2: 2: 0: 0: 1: 0:
> > 0: 1
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 573392
> >
> > ###TEST-D: TCP_RR - time out while waiting for prompt after running
> > netperf
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 4,4
> > Throughput: 1.22/1.22 Mbits/sec
> > Transactions Per Second: 19001.32
> > Client CPU Usage: 22.10%
> > Server CPU Usage: 20.03%
> > Average Latency: 26.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 13262: 550244: 6264: 155:
> > 106: 38
> > HUNDRED_USEC : 0: 56: 1: 3: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 570129
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 8,8
> > Throughput: 2.44/2.44 Mbits/sec
> > Transactions Per Second: 19087.51
> > Client CPU Usage: 20.30%
> > Server CPU Usage: 18.43%
> > Average Latency: 26.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 1: 45552: 517309: 9386: 294:
> > 104: 29
> > HUNDRED_USEC : 0: 54: 4: 1: 0: 0: 0: 0:
> > 0: 1
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 572735
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 16,16
> > Throughput: 4.88/4.88 Mbits/sec
> > Transactions Per Second: 19081.21
> > Client CPU Usage: 20.26%
> > Server CPU Usage: 18.58%
> > Average Latency: 26.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 46348: 519429: 6348: 214:
> > 79: 46
> > HUNDRED_USEC : 0: 53: 6: 1: 1: 0: 2: 0:
> > 1: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 572528
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 32,32
> > Throughput: 9.75/9.75 Mbits/sec
> > Transactions Per Second: 19046.54
> > Client CPU Usage: 20.63%
> > Server CPU Usage: 18.85%
> > Average Latency: 26.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 1: 0: 30002: 535394: 5747: 156:
> > 96: 32
> > HUNDRED_USEC : 0: 61: 3: 0: 0: 1: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 571493
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 64,64
> > Throughput: 19.45/19.45 Mbits/sec
> > Transactions Per Second: 18996.25
> > Client CPU Usage: 21.95%
> > Server CPU Usage: 20.03%
> > Average Latency: 26.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 1: 13818: 549420: 6398: 166:
> > 82: 39
> > HUNDRED_USEC : 0: 51: 3: 3: 0: 0: 1: 1:
> > 1: 1
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 569985
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 128,128
> > Throughput: 38.73/38.73 Mbits/sec
> > Transactions Per Second: 18912.96
> > Client CPU Usage: 24.26%
> > Server CPU Usage: 22.57%
> > Average Latency: 26.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 1: 3: 3757: 554740: 8578: 205:
> > 104: 34
> > HUNDRED_USEC : 0: 55: 4: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 1: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 567482
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 256,256
> > Throughput: 76.31/76.31 Mbits/sec
> > Transactions Per Second: 18629.90
> > Client CPU Usage: 27.60%
> > Server CPU Usage: 25.58%
> > Average Latency: 26.5 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 2449: 539867: 16217: 268:
> > 95: 43
> > HUNDRED_USEC : 0: 50: 3: 1: 0: 1: 0: 1:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 558995
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 512,512
> > Throughput: 148.64/148.64 Mbits/sec
> > Transactions Per Second: 18144.48
> > Client CPU Usage: 24.61%
> > Server CPU Usage: 22.77%
> > Average Latency: 27.5 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 808: 504640: 38411: 357:
> > 117: 47
> > HUNDRED_USEC : 0: 56: 2: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 544438
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 1024,1024
> > Throughput: 283.92/283.92 Mbits/sec
> > Transactions Per Second: 17329.03
> > Client CPU Usage: 24.45%
> > Server CPU Usage: 22.93%
> > Average Latency: 28.5 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 1: 9: 465727: 53008: 946:
> > 105: 90
> > HUNDRED_USEC : 0: 63: 4: 0: 0: 2: 0: 1:
> > 0: 1
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 519957
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 2048,2048
> > Throughput: 549.59/549.59 Mbits/sec
> > Transactions Per Second: 16772.13
> > Client CPU Usage: 21.96%
> > Server CPU Usage: 20.53%
> > Average Latency: 29.5 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 1: 1: 421409: 77980: 3534:
> > 153: 93
> > HUNDRED_USEC : 0: 73: 2: 0: 0: 0: 0: 1:
> > 0: 1
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 503248
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 4096,4096
> > Throughput: 949.86/949.86 Mbits/sec
> > Transactions Per Second: 14493.71
> > Client CPU Usage: 22.49%
> > Server CPU Usage: 20.96%
> > Average Latency: 34.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 1: 8: 370233: 62268:
> > 2079: 136
> > HUNDRED_USEC : 0: 142: 3: 0: 0: 1: 0: 1:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 434873
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 8192,8192
> > Throughput: 1603.56/1603.56 Mbits/sec
> > Transactions Per Second: 12234.23
> > Client CPU Usage: 21.35%
> > Server CPU Usage: 20.78%
> > Average Latency: 40.5 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 1: 0: 11: 276533:
> > 55119: 10813
> > HUNDRED_USEC : 0: 24603: 8: 4: 1: 1: 1: 0:
> > 1: 2
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 367098
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 16384,16384
> > Throughput: 2320.31/2320.31 Mbits/sec
> > Transactions Per Second: 8851.27
> > Client CPU Usage: 27.71%
> > Server CPU Usage: 26.08%
> > Average Latency: 56.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 1: 92078
> > HUNDRED_USEC : 0: 173491: 15: 0: 0: 0: 0: 1:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 265586
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 32768,32768
> > Throughput: 3056.68/3056.68 Mbits/sec
> > Transactions Per Second: 5830.15
> > Client CPU Usage: 31.51%
> > Server CPU Usage: 31.31%
> > Average Latency: 85.5 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 1
> > HUNDRED_USEC : 0: 167269: 7658: 2: 0: 0: 0: 1:
> > 2: 1
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 174934
> >
> > ###TEST-D: TCP_RR - time out while waiting for prompt after running
> > netperf
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 65536,65536
> > Throughput: 4218.71/4218.71 Mbits/sec
> > Transactions Per Second: 4023.28
> > Client CPU Usage: 37.73%
> > Server CPU Usage: 36.54%
> > Average Latency: 124.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 120507: 192: 10: 0: 0: 0:
> > 2: 2
> > UNIT_MSEC : 0: 2: 1: 2: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 120718
> >
> > ###TEST-D: TCP_RR - time out while waiting for prompt after running
> > netperf
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 131072,131072
> > Throughput: 4993.36/4993.36 Mbits/sec
> > Transactions Per Second: 2381.02
> > Client CPU Usage: 41.09%
> > Server CPU Usage: 40.58%
> > Average Latency: 209.5 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 5703: 65707: 19: 5: 1:
> > 1: 0
> > UNIT_MSEC : 0: 6: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 71442
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 262144,262144
> > Throughput: 5546.63/5546.63 Mbits/sec
> > Transactions Per Second: 1322.42
> > Client CPU Usage: 44.56%
> > Server CPU Usage: 44.21%
> > Average Latency: 378.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 0: 0: 0: 39543:
> > 117: 9
> > UNIT_MSEC : 0: 11: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 39680
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 524288,524288
> > Throughput: 5866.91/5866.91 Mbits/sec
> > Transactions Per Second: 699.39
> > Client CPU Usage: 46.18%
> > Server CPU Usage: 40.50%
> > Average Latency: 714.5 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 20978: 7: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 20985
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 1048576,1048576
> > Throughput: 5797.37/5797.37 Mbits/sec
> > Transactions Per Second: 345.55
> > Client CPU Usage: 47.22%
> > Server CPU Usage: 47.06%
> > Average Latency: 1446.5 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 10252: 113: 1: 0: 1: 1:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 10368
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 2097152,2097152
> > Throughput: 5536.15/5536.15 Mbits/sec
> > Transactions Per Second: 164.99
> > Client CPU Usage: 45.58%
> > Server CPU Usage: 45.49%
> > Average Latency: 3029.5 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 11: 4936: 3:
> > 0: 1
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 4951
> >
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 4194304,4194304
> > Throughput: 5398.91/5398.91 Mbits/sec
> > Transactions Per Second: 80.45
> > Client CPU Usage: 44.99%
> > Server CPU Usage: 44.91%
> > Average Latency: 6213.5 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 2414: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 2414
> >
> > IP.Performance.Netperf.SDP2SDP.TCP_RR --> PASS
> > IP.Performance.Netperf.SDP2SDP.UDP_STREAM --> PASS
> > ###TEST-W: sdp2sdp - time out while running netperf
> > ###TEST-E: TCP_CC Test sdp2sdp failed
> > IP.Performance.Netperf.SDP2SDP.TCP_CC --> FAIL
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 1 Bytes
> > Throughput: 1.63 Mbits/sec
> > Transactions Per Second: 203750.00
> > Client CPU Usage: 56.57%
> > Server CPU Usage: 33.38%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1546: 3620: 4289558: 767615: 16063: 52213: 202820:
> > 268889: 54344: 35831
> > TEN_USEC : 0: 409296: 4574: 132: 22: 55: 22: 15:
> > 3: 1
> > HUNDRED_USEC : 0: 10: 0: 1: 0: 1: 0: 1:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 6106632
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 2 Bytes
> > Throughput: 3.27 Mbits/sec
> > Transactions Per Second: 204375.00
> > Client CPU Usage: 63.81%
> > Server CPU Usage: 30.80%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1786: 3706: 4203159: 664997: 15828: 104196: 416311:
> > 211066: 37292: 74208
> > TEN_USEC : 0: 394453: 3465: 86: 21: 48: 12: 6:
> > 2: 5
> > HUNDRED_USEC : 0: 7: 1: 0: 0: 1: 0: 0:
> > 1: 2
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 6130659
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 4 Bytes
> > Throughput: 6.42 Mbits/sec
> > Transactions Per Second: 200625.00
> > Client CPU Usage: 63.92%
> > Server CPU Usage: 31.81%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1730: 3426: 3759926: 922474: 20583: 123232: 447747:
> > 207321: 51995: 74624
> > TEN_USEC : 0: 402171: 4214: 88: 18: 54: 26: 13:
> > 4: 1
> > HUNDRED_USEC : 0: 12: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 6019659
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 8 Bytes
> > Throughput: 13.06 Mbits/sec
> > Transactions Per Second: 204062.50
> > Client CPU Usage: 62.71%
> > Server CPU Usage: 32.91%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 2315: 4019: 4163727: 761681: 16299: 97466: 335215:
> > 233671: 44906: 51181
> > TEN_USEC : 0: 408810: 4624: 144: 39: 85: 30: 7:
> > 7: 13
> > HUNDRED_USEC : 0: 13: 0: 0: 1: 0: 0: 2:
> > 0: 2
> > UNIT_MSEC : 0: 3: 1: 0: 1: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 6124262
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 16 Bytes
> > Throughput: 25.97 Mbits/sec
> > Transactions Per Second: 202890.62
> > Client CPU Usage: 63.64%
> > Server CPU Usage: 33.03%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1869: 3552: 4088848: 772860: 13470: 81621: 402002:
> > 203872: 36523: 44314
> > TEN_USEC : 0: 434566: 4204: 93: 17: 56: 21: 13:
> > 3: 1
> > HUNDRED_USEC : 0: 10: 0: 0: 0: 0: 0: 2:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 6087917
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 32 Bytes
> > Throughput: 51.95 Mbits/sec
> > Transactions Per Second: 202929.69
> > Client CPU Usage: 58.57%
> > Server CPU Usage: 32.10%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 4513: 5579: 4103364: 900271: 19704: 61814: 248887:
> > 229582: 58390: 19764
> > TEN_USEC : 0: 429313: 7754: 144: 16: 60: 33: 8:
> > 2: 3
> > HUNDRED_USEC : 0: 12: 0: 1: 1: 0: 0: 3:
> > 0: 0
> > UNIT_MSEC : 0: 1: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 6089219
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 64 Bytes
> > Throughput: 115.41 Mbits/sec
> > Transactions Per Second: 225410.16
> > Client CPU Usage: 57.74%
> > Server CPU Usage: 25.76%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 3579: 5232: 4623697: 1130479: 24339: 80864: 266110:
> > 234544: 51826: 12985
> > TEN_USEC : 0: 325689: 3738: 102: 22: 42: 8: 7:
> > 6: 3
> > HUNDRED_USEC : 0: 13: 1: 1: 1: 0: 0: 1:
> > 0: 1
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 6763290
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 128 Bytes
> > Throughput: 217.21 Mbits/sec
> > Transactions Per Second: 212119.14
> > Client CPU Usage: 57.51%
> > Server CPU Usage: 29.46%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 3241: 4978: 3727165: 1550300: 37366: 89538: 300181:
> > 221016: 78597: 6660
> > TEN_USEC : 0: 340606: 4953: 142: 27: 39: 14: 2:
> > 6: 8
> > HUNDRED_USEC : 0: 15: 3: 1: 0: 0: 0: 1:
> > 1: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 6364860
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 256 Bytes
> > Throughput: 305.78 Mbits/sec
> > Transactions Per Second: 149306.64
> > Client CPU Usage: 61.26%
> > Server CPU Usage: 37.09%
> > Average Latency: 6.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1042: 2138: 1410482: 1478485: 52093: 52092: 495419:
> > 252723: 172298: 66955
> > TEN_USEC : 0: 442273: 52891: 810: 34: 40: 21: 16:
> > 8: 4
> > HUNDRED_USEC : 0: 18: 2: 3: 1: 0: 0: 2:
> > 1: 1
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 4479852
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 512 Bytes
> > Throughput: 455.26 Mbits/sec
> > Transactions Per Second: 111147.46
> > Client CPU Usage: 62.72%
> > Server CPU Usage: 39.23%
> > Average Latency: 8.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 72: 835: 193755: 1321135: 101822: 18518: 337330:
> > 418120: 192314: 181050
> > TEN_USEC : 0: 385439: 180390: 4047: 93: 47: 25: 20:
> > 17: 5
> > HUNDRED_USEC : 0: 17: 2: 0: 0: 0: 0: 2:
> > 2: 0
> > UNIT_MSEC : 0: 1: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 3335058
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 1024 Bytes
> > Throughput: 628.04 Mbits/sec
> > Transactions Per Second: 76665.04
> > Client CPU Usage: 62.91%
> > Server CPU Usage: 42.84%
> > Average Latency: 13.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 7: 57: 367: 155083: 418348: 17624: 12431:
> > 177177: 180002: 171892
> > TEN_USEC : 0: 883453: 269577: 12848: 1288: 75: 43: 19:
> > 20: 10
> > HUNDRED_USEC : 0: 24: 1: 1: 0: 2: 1: 1:
> > 2: 1
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 2300354
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 2048 Bytes
> > Throughput: 794.88 Mbits/sec
> > Transactions Per Second: 48515.62
> > Client CPU Usage: 59.67%
> > Server CPU Usage: 44.81%
> > Average Latency: 20.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 1: 28: 687: 217: 2008:
> > 111008: 73027
> > TEN_USEC : 0: 695909: 462891: 102577: 6828: 331: 98:
> > 50: 30: 19
> > HUNDRED_USEC : 0: 39: 5: 2: 1: 0: 0: 0:
> > 1: 4
> > UNIT_MSEC : 0: 1: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 1455762
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 4096 Bytes
> > Throughput: 995.45 Mbits/sec
> > Transactions Per Second: 30378.72
> > Client CPU Usage: 56.21%
> > Server CPU Usage: 45.99%
> > Average Latency: 32.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1: 0: 0: 0: 0: 0: 1: 435:
> > 1504: 186
> > TEN_USEC : 0: 121123: 284176: 362458: 130712: 9339: 1050:
> > 181: 81: 58
> > HUNDRED_USEC : 0: 200: 13: 4: 0: 0: 1: 3:
> > 2: 0
> > UNIT_MSEC : 0: 1: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 911529
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 8192 Bytes
> > Throughput: 1219.41 Mbits/sec
> > Transactions Per Second: 18606.72
> > Client CPU Usage: 53.38%
> > Server CPU Usage: 48.31%
> > Average Latency: 53.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 1334: 11629: 70629: 154925: 232617: 65151:
> > 18254: 1736: 224
> > HUNDRED_USEC : 0: 1793: 16: 5: 0: 1: 0: 1:
> > 1: 1
> > UNIT_MSEC : 0: 3: 1: 1: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 558322
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 16384 Bytes
> > Throughput: 1420.25 Mbits/sec
> > Transactions Per Second: 10835.65
> > Client CPU Usage: 51.88%
> > Server CPU Usage: 49.01%
> > Average Latency: 92.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 54: 43: 59: 99: 3216: 39170:
> > 125595: 112899
> > HUNDRED_USEC : 0: 43950: 33: 8: 0: 0: 0: 0:
> > 3: 3
> > UNIT_MSEC : 0: 2: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 325134
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 32768 Bytes
> > Throughput: 1593.83 Mbits/sec
> > Transactions Per Second: 6079.98
> > Client CPU Usage: 51.56%
> > Server CPU Usage: 49.53%
> > Average Latency: 164.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 2: 0:
> > 3: 1
> > HUNDRED_USEC : 0: 180985: 1410: 15: 8: 0: 1: 0:
> > 0: 2
> > UNIT_MSEC : 0: 4: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 182431
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 65536 Bytes
> > Throughput: 1701.94 Mbits/sec
> > Transactions Per Second: 3246.19
> > Client CPU Usage: 51.74%
> > Server CPU Usage: 49.69%
> > Average Latency: 307.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 39832: 57432: 122: 10: 2: 0:
> > 0: 0
> > UNIT_MSEC : 0: 8: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 97406
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 131072 Bytes
> > Throughput: 1719.41 Mbits/sec
> > Transactions Per Second: 1639.76
> > Client CPU Usage: 49.88%
> > Server CPU Usage: 49.24%
> > Average Latency: 609.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 0: 19369: 29437: 373:
> > 9: 7
> > UNIT_MSEC : 0: 7: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 49202
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 262144 Bytes
> > Throughput: 1721.64 Mbits/sec
> > Transactions Per Second: 820.94
> > Client CPU Usage: 49.39%
> > Server CPU Usage: 49.28%
> > Average Latency: 1217.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 24624: 7: 1: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 24632
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 524288 Bytes
> > Throughput: 1722.80 Mbits/sec
> > Transactions Per Second: 410.75
> > Client CPU Usage: 49.01%
> > Server CPU Usage: 49.13%
> > Average Latency: 2434.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 12317: 7: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 12324
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 1048576 Bytes
> > Throughput: 1726.26 Mbits/sec
> > Transactions Per Second: 205.79
> > Client CPU Usage: 48.94%
> > Server CPU Usage: 49.18%
> > Average Latency: 4859.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 6048: 123: 3: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 6174
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 2097152 Bytes
> > Throughput: 1730.01 Mbits/sec
> > Transactions Per Second: 103.12
> > Client CPU Usage: 48.56%
> > Server CPU Usage: 49.26%
> > Average Latency: 9696.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 3042
> > TEN_MSEC : 0: 52: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 3094
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 4194304 Bytes
> > Throughput: 1729.43 Mbits/sec
> > Transactions Per Second: 51.54
> > Client CPU Usage: 48.79%
> > Server CPU Usage: 48.94%
> > Average Latency: 19404.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 1509: 37: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 1546
> >
> > IP.Performance.Netperf.IPoIB2IPoIB.TCP_STREAM --> PASS
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 1,1
> > Throughput: 0.25/0.25 Mbits/sec
> > Transactions Per Second: 15500.66
> > Client CPU Usage: 29.66%
> > Server CPU Usage: 27.52%
> > Average Latency: 32.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 1610: 446151: 16807:
> > 251: 145
> > HUNDRED_USEC : 0: 126: 3: 1: 1: 1: 1: 0:
> > 0: 1
> > UNIT_MSEC : 0: 1: 1: 2: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 465103
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 2,2
> > Throughput: 0.50/0.50 Mbits/sec
> > Transactions Per Second: 15523.54
> > Client CPU Usage: 28.61%
> > Server CPU Usage: 28.16%
> > Average Latency: 32.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 1: 0: 1: 1854: 446997: 16524:
> > 194: 90
> > HUNDRED_USEC : 0: 123: 2: 0: 1: 0: 0: 0:
> > 1: 0
> > UNIT_MSEC : 0: 1: 1: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 465791
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 4,4
> > Throughput: 0.99/0.99 Mbits/sec
> > Transactions Per Second: 15448.48
> > Client CPU Usage: 29.90%
> > Server CPU Usage: 27.95%
> > Average Latency: 32.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 1: 1: 1277: 443834: 18020:
> > 192: 101
> > HUNDRED_USEC : 0: 106: 3: 0: 2: 0: 0: 0:
> > 2: 2
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 463541
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 8,8
> > Throughput: 1.98/1.98 Mbits/sec
> > Transactions Per Second: 15500.10
> > Client CPU Usage: 28.83%
> > Server CPU Usage: 27.20%
> > Average Latency: 32.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 1704: 444472: 18430:
> > 264: 105
> > HUNDRED_USEC : 0: 102: 3: 1: 0: 1: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 465082
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 16,16
> > Throughput: 3.94/3.94 Mbits/sec
> > Transactions Per Second: 15389.45
> > Client CPU Usage: 30.53%
> > Server CPU Usage: 28.56%
> > Average Latency: 32.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 1147: 440439: 19710:
> > 267: 91
> > HUNDRED_USEC : 0: 97: 4: 1: 0: 1: 0: 0:
> > 1: 1
> > UNIT_MSEC : 0: 1: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 461760
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 32,32
> > Throughput: 7.86/7.86 Mbits/sec
> > Transactions Per Second: 15361.10
> > Client CPU Usage: 30.58%
> > Server CPU Usage: 28.95%
> > Average Latency: 32.5 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 906: 438581: 20971:
> > 253: 105
> > HUNDRED_USEC : 0: 104: 0: 0: 0: 1: 0: 1:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 460923
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 64,64
> > Throughput: 15.66/15.66 Mbits/sec
> > Transactions Per Second: 15290.80
> > Client CPU Usage: 32.06%
> > Server CPU Usage: 30.11%
> > Average Latency: 32.5 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 622: 433236: 24341:
> > 378: 105
> > HUNDRED_USEC : 0: 114: 2: 1: 0: 0: 0: 1:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 458800
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 128,128
> > Throughput: 30.83/30.83 Mbits/sec
> > Transactions Per Second: 15054.27
> > Client CPU Usage: 26.76%
> > Server CPU Usage: 25.05%
> > Average Latency: 33.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 304: 416919: 33708:
> > 512: 99
> > HUNDRED_USEC : 0: 158: 3: 0: 0: 0: 0: 1:
> > 0: 0
> > UNIT_MSEC : 0: 1: 0: 1: 1: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 451707
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 256,256
> > Throughput: 60.55/60.55 Mbits/sec
> > Transactions Per Second: 14782.89
> > Client CPU Usage: 30.49%
> > Server CPU Usage: 29.31%
> > Average Latency: 33.5 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 1: 0: 0: 0: 25: 394804: 47832:
> > 635: 91
> > HUNDRED_USEC : 0: 160: 3: 1: 0: 0: 0: 1:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 443554
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 512,512
> > Throughput: 117.76/117.76 Mbits/sec
> > Transactions Per Second: 14375.47
> > Client CPU Usage: 28.15%
> > Server CPU Usage: 26.60%
> > Average Latency: 34.5 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 1: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 3: 363365: 66517:
> > 1112: 160
> > HUNDRED_USEC : 0: 175: 4: 0: 1: 0: 0: 1:
> > 0: 1
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 431340
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 1024,1024
> > Throughput: 222.20/222.20 Mbits/sec
> > Transactions Per Second: 13561.90
> > Client CPU Usage: 30.00%
> > Server CPU Usage: 28.76%
> > Average Latency: 36.5 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 1685: 394238:
> > 10532: 269
> > HUNDRED_USEC : 0: 197: 3: 1: 0: 0: 2: 0:
> > 0: 1
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 406928
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 2048,2048
> > Throughput: 305.13/305.13 Mbits/sec
> > Transactions Per Second: 9311.71
> > Client CPU Usage: 38.59%
> > Server CPU Usage: 38.60%
> > Average Latency: 53.5 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 216: 49068
> > HUNDRED_USEC : 0: 230094: 16: 3: 0: 1: 3: 1:
> > 0: 1
> > UNIT_MSEC : 0: 0: 1: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 279404
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 4096,4096
> > Throughput: 542.06/542.06 Mbits/sec
> > Transactions Per Second: 8271.22
> > Client CPU Usage: 40.78%
> > Server CPU Usage: 37.96%
> > Average Latency: 60.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 248142: 27: 5: 0: 2: 0: 1:
> > 3: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 248180
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 8192,8192
> > Throughput: 797.34/797.34 Mbits/sec
> > Transactions Per Second: 6083.19
> > Client CPU Usage: 42.71%
> > Server CPU Usage: 41.68%
> > Average Latency: 82.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 182364: 146: 11: 2: 0: 0: 0:
> > 3: 2
> > UNIT_MSEC : 0: 2: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 182530
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 16384,16384
> > Throughput: 1157.44/1157.44 Mbits/sec
> > Transactions Per Second: 4415.28
> > Client CPU Usage: 44.99%
> > Server CPU Usage: 43.21%
> > Average Latency: 113.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 132410: 51: 14: 0: 0: 1:
> > 0: 2
> > UNIT_MSEC : 0: 4: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 132482
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 32768,32768
> > Throughput: 1452.17/1452.17 Mbits/sec
> > Transactions Per Second: 2769.80
> > Client CPU Usage: 46.36%
> > Server CPU Usage: 46.46%
> > Average Latency: 180.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 82724: 362: 9: 4: 1:
> > 0: 0
> > UNIT_MSEC : 0: 8: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 83108
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 65536,65536
> > Throughput: 1673.55/1673.55 Mbits/sec
> > Transactions Per Second: 1596.02
> > Client CPU Usage: 49.18%
> > Server CPU Usage: 49.51%
> > Average Latency: 313.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 0: 1643: 46044: 165:
> > 13: 4
> > UNIT_MSEC : 0: 15: 1: 3: 0: 1: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 47889
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 131072,131072
> > Throughput: 1612.14/1612.14 Mbits/sec
> > Transactions Per Second: 768.73
> > Client CPU Usage: 47.64%
> > Server CPU Usage: 48.08%
> > Average Latency: 650.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 23061: 5: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 23066
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 262144,262144
> > Throughput: 1627.64/1627.64 Mbits/sec
> > Transactions Per Second: 388.06
> > Client CPU Usage: 47.19%
> > Server CPU Usage: 47.23%
> > Average Latency: 1288.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 11630: 14: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 11644
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 524288,524288
> > Throughput: 1615.65/1615.65 Mbits/sec
> > Transactions Per Second: 192.60
> > Client CPU Usage: 42.38%
> > Server CPU Usage: 41.98%
> > Average Latency: 2595.5 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 5773: 5: 1:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 5779
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 1048576,1048576
> > Throughput: 1585.11/1585.11 Mbits/sec
> > Transactions Per Second: 94.48
> > Client CPU Usage: 44.73%
> > Server CPU Usage: 45.28%
> > Average Latency: 5291.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 2835: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 2835
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 2097152,2097152
> > Throughput: 1573.37/1573.37 Mbits/sec
> > Transactions Per Second: 46.89
> > Client CPU Usage: 44.41%
> > Server CPU Usage: 44.44%
> > Average Latency: 10660.5 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 1407: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 1407
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 4194304,4194304
> > Throughput: 1570.35/1570.35 Mbits/sec
> > Transactions Per Second: 23.40
> > Client CPU Usage: 44.66%
> > Server CPU Usage: 44.94%
> > Average Latency: 21367.5 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 701: 1: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 702
> >
> > IP.Performance.Netperf.IPoIB2IPoIB.TCP_RR --> PASS
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 1 Bytes
> > Send/Receive Throughput: 0.8/0.8 Mbits/sec
> > Transactions Per Second: 100000.00/100000.00
> > Client CPU Usage: 70.17%
> > Server CPU Usage: 39.00%
> > Average Latency: 10.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 2: 1: 4: 397: 32444: 590880: 127843:
> > 17261: 102335: 476289
> > TEN_USEC : 0: 1468054: 5039: 158: 38: 26: 29: 8:
> > 3: 5
> > HUNDRED_USEC : 0: 3: 1: 0: 0: 1: 0: 0:
> > 0: 1
> > UNIT_MSEC : 0: 1: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 2820823
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 2 Bytes
> > Send/Receive Throughput: 1.5/1.5 Mbits/sec
> > Transactions Per Second: 93750.00/93750.00
> > Client CPU Usage: 68.47%
> > Server CPU Usage: 39.26%
> > Average Latency: 10.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 2: 0: 7: 499: 49633: 663700: 113340:
> > 16018: 96336: 459767
> > TEN_USEC : 0: 1453041: 5364: 161: 38: 32: 22: 11:
> > 3: 1
> > HUNDRED_USEC : 0: 5: 0: 0: 0: 0: 0: 2:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 2857982
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 4 Bytes
> > Send/Receive Throughput: 3.0/3.0 Mbits/sec
> > Transactions Per Second: 93750.00/93750.00
> > Client CPU Usage: 72.74%
> > Server CPU Usage: 40.53%
> > Average Latency: 10.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 2: 351: 24587: 533947: 153488:
> > 28226: 97645: 446253
> > TEN_USEC : 0: 1516044: 4598: 141: 34: 42: 36: 16:
> > 2: 1
> > HUNDRED_USEC : 0: 18: 0: 0: 0: 0: 1: 2:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 2805434
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 8 Bytes
> > Send/Receive Throughput: 6.1/6.1 Mbits/sec
> > Transactions Per Second: 95312.50/95312.50
> > Client CPU Usage: 66.61%
> > Server CPU Usage: 39.66%
> > Average Latency: 10.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 1: 3: 497: 30938: 728412: 101538:
> > 11105: 76062: 383069
> > TEN_USEC : 0: 1525813: 6627: 193: 35: 34: 35: 9:
> > 3: 1
> > HUNDRED_USEC : 0: 17: 1: 0: 0: 0: 1: 2:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 2864396
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 16 Bytes
> > Send/Receive Throughput: 12.4/12.4 Mbits/sec
> > Transactions Per Second: 96875.00/96875.00
> > Client CPU Usage: 63.31%
> > Server CPU Usage: 39.75%
> > Average Latency: 10.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 1: 597: 21952: 829144: 123332:
> > 11243: 61878: 331263
> > TEN_USEC : 0: 1517643: 7749: 199: 37: 44: 37: 7:
> > 3: 1
> > HUNDRED_USEC : 0: 19: 1: 0: 0: 0: 1: 1:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 2905152
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 32 Bytes
> > Send/Receive Throughput: 24.5/24.5 Mbits/sec
> > Transactions Per Second: 95703.12/95703.12
> > Client CPU Usage: 64.59%
> > Server CPU Usage: 39.88%
> > Average Latency: 10.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 8: 0: 0: 518: 12974: 753506: 142912:
> > 12380: 66056: 335648
> > TEN_USEC : 0: 1542888: 7424: 186: 46: 32: 22: 9:
> > 1: 3
> > HUNDRED_USEC : 0: 5: 0: 0: 0: 1: 0: 0:
> > 1: 1
> > UNIT_MSEC : 0: 1: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 2874622
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 64 Bytes
> > Send/Receive Throughput: 48.6/48.6 Mbits/sec
> > Transactions Per Second: 94921.88/94921.88
> > Client CPU Usage: 65.49%
> > Server CPU Usage: 40.20%
> > Average Latency: 10.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 429: 5501: 684597: 155846: 12068:
> > 73608: 327969
> > TEN_USEC : 0: 1581916: 7180: 189: 30: 35: 31: 4:
> > 1: 4
> > HUNDRED_USEC : 0: 7: 0: 0: 0: 0: 0: 1:
> > 0: 2
> > UNIT_MSEC : 0: 0: 1: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 2849419
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 128 Bytes
> > Send/Receive Throughput: 97.5/97.5 Mbits/sec
> > Transactions Per Second: 95214.84/95214.84
> > Client CPU Usage: 62.69%
> > Server CPU Usage: 40.53%
> > Average Latency: 10.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 322: 1550: 614832: 270355: 11438:
> > 54148: 260719
> > TEN_USEC : 0: 1633536: 9293: 217: 47: 49: 31: 6:
> > 5: 2
> > HUNDRED_USEC : 0: 22: 1: 0: 0: 0: 1: 0:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 2856574
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 256 Bytes
> > Send/Receive Throughput: 184.8/184.8 Mbits/sec
> > Transactions Per Second: 90234.38/90234.38
> > Client CPU Usage: 68.45%
> > Server CPU Usage: 40.53%
> > Average Latency: 11.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 123: 470: 281438: 335195: 14487:
> > 71901: 206608
> > TEN_USEC : 0: 1788067: 8570: 203: 43: 31: 51: 11:
> > 4: 1
> > HUNDRED_USEC : 0: 19: 1: 0: 0: 0: 1: 2:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 2707226
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 512 Bytes
> > Send/Receive Throughput: 345.4/345.4 Mbits/sec
> > Transactions Per Second: 84326.17/84326.17
> > Client CPU Usage: 71.67%
> > Server CPU Usage: 41.18%
> > Average Latency: 11.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 34: 329: 53554: 388481: 27396:
> > 60007: 114619
> > TEN_USEC : 0: 1876967: 8558: 173: 40: 31: 47: 16:
> > 3: 1
> > HUNDRED_USEC : 0: 20: 0: 0: 0: 0: 1: 2:
> > 0: 0
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 2530279
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 1024 Bytes
> > Send/Receive Throughput: 641.9/641.8 Mbits/sec
> > Transactions Per Second: 78356.93/78344.73
> > Client CPU Usage: 70.04%
> > Server CPU Usage: 40.40%
> > Average Latency: 12.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 78: 270: 160408: 285776:
> > 45574: 141023
> > TEN_USEC : 0: 1702839: 14783: 227: 39: 30: 35: 14:
> > 3: 5
> > HUNDRED_USEC : 0: 3: 2: 0: 0: 0: 0: 2:
> > 0: 2
> > UNIT_MSEC : 0: 0: 0: 0: 1: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 2351114
> >
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 1400 Bytes
> > Send/Receive Throughput: 845.7/845.3 Mbits/sec
> > Transactions Per Second: 75508.93/75473.21
> > Client CPU Usage: 68.94%
> > Server CPU Usage: 41.16%
> > Average Latency: 13.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 2: 0: 0: 0: 21: 233: 26835: 315643:
> > 26904: 93682
> > TEN_USEC : 0: 1783838: 17988: 307: 41: 23: 39: 8:
> > 0: 1
> > HUNDRED_USEC : 0: 9: 1: 0: 0: 0: 0: 0:
> > 2: 1
> > UNIT_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 2265578
> >
> > IP.Performance.Netperf.IPoIB2IPoIB.UDP_STREAM --> PASS
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_CC
> > Test Duration: 30 seconds
> > Transactions Per Second: 7125.44
> > Client CPU Usage: 36.28%
> > Server CPU Usage: 30.75%
> > Average Latency: 70.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > HUNDRED_USEC : 0: 213764: 29: 4: 0: 0: 1: 0:
> > 0: 1
> > UNIT_MSEC : 0: 1: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 213800
> >
> > IP.Performance.Netperf.IPoIB2IPoIB.TCP_CC --> PASS
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_CRR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 1,1
> > Throughput: 0.09/0.09 Mbits/sec
> > Transactions Per Second: 5591.58
> > Client CPU Usage: 38.94%
> > Server CPU Usage: 34.20%
> > Average Latency: 89.0 usec
> > Histogram of latency distribution:
> > UNITS 0 1 2 3 4 5 6 7 8
> > 9
> > UNIT_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_USEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 1
> > HUNDRED_USEC : 0: 167454: 307: 3: 2: 0: 0: 1:
> > 0: 2
> > UNIT_MSEC : 0: 1: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TEN_MSEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > TENTH_SEC : 0: 0: 0: 0: 0: 0: 0: 0:
> > 0: 0
> > >1_SECS: 0
> > HIST_TOTAL: 167771
> >
> > IP.Performance.Netperf.IPoIB2IPoIB.TCP_CRR --> PASS
> > ###TEST-S: Skipping ipoib2eth netperf test. No EN hosts present.
> > IP.Performance.Netperf.IPoIB2Eth --> SKIP
> > ###TEST-S: Skipping Tests. No EN GWs present.
> > Smoke.MGMT.ConfigL3Mode --> SKIP
> > ###TEST-S: Skipping eth2eth netperf test. No EN hosts present.
> > IP.Performance.Netperf.Eth2Eth --> SKIP
> > ###TEST-S: Skipping Tests. No EN GWs present.
> > Smoke.MGMT.ConfigL25Mode --> SKIP
> > ###TEST-S: Skipping eth2ipoib netperf test. No EN hosts present.
> > IP.Performance.Netperf.Eth2IPoIB --> SKIP
> > Smoke.MGMT.MgmtIb --> PASS
> >
> > End of protest run
> >
> >
> _______________________________________________
> openfabrics-ewg mailing list
> openfabrics-ewg at openib.org
> http://openib.org/mailman/listinfo/openfabrics-ewg
-------------- next part --------------
sysctl -w net.ipv4.tcp_rmem="4096 87380 16777216"
sysctl -w net.ipv4.tcp_wmem="4096 65536 16777216"
sysctl net.core.rmem_default=87380
sysctl net.core.rmem_max=16777216
sysctl net.core.wmem_max=16777216
sysctl net.core.wmem_default=87380
All benchmarks are with RHEL4 x86_64 with HCA FW v4.7.0
dual EM64T 3.2 GHz PCIe IB HCA (memfull)
patch 1 - remove changeset 314324121f9b94b2ca657a494cf2b9cb0e4a28cc
patch 2 - remove changeset b8259d9ad1d0f8d0c5ea0e37bb15080b0bd395b5
msi_x=1 for all tests
Kernel OpenIB netperf (MB/s)
2.6.16-rc5 in-kernel 403
tcp_wmem 4096 87380 16777216 tcp_rmem 4096 87380 16777216
2.6.16-rc5 in-kernel 395
tcp_wmem 4096 102400 16777216 tcp_rmem 4096 102400 16777216
2.6.16-rc5 in-kernel 392
tcp_wmem 4096 65536 16777216 tcp_rmem 4096 87380 16777216
2.6.16-rc5 in-kernel 394
tcp_wmem 4096 131072 16777216 tcp_rmem 4096 102400 16777216
2.6.16-rc5 in-kernel 377
tcp_wmem 4096 131072 16777216 tcp_rmem 4096 153600 16777216
2.6.16-rc5 in-kernel 377
tcp_wmem 4096 131072 16777216 tcp_rmem 4096 131072 16777216
2.6.16-rc5 in-kernel 353
tcp_wmem 4096 262144 16777216 tcp_rmem 4096 262144 16777216
2.6.16-rc5 in-kernel 305
tcp_wmem 4096 262144 16777216 tcp_rmem 4096 524288 16777216
2.6.16-rc5 in-kernel 303
tcp_wmem 4096 131072 16777216 tcp_rmem 4096 524288 16777216
2.6.16-rc5 in-kernel 290
tcp_wmem 4096 524288 16777216 tcp_rmem 4096 524288 16777216
2.6.16-rc5 in-kernel 367 default tcp values
--------------------
netperf -f -M -c -C -H IP_ADDRESS
Kernel OpenIB netperf (MB/s)
2.6.16 svn 6083 371 (mthca ipoib)
2.6.16 svn 6083 304 (ipath ipoib)
2.6.16 svn 5938 300 (ipath ipoib)
2.6.16 svn 5938 380 (mthca ipoib)
2.6.16 in-kernel 364
2.6.16-rc5 in-kernel 367
2.6.15 in-kernel 382
2.6.14-rc4 patch 12 in-kernel 436
2.6.14-rc4 patch 1 in-kernel 434
2.6.14-rc4 in-kernel 385
2.6.14-rc3 in-kernel 374
2.6.13.2 svn3627 386
2.6.13.2 patch 1 svn3627 446
2.6.13.2 in-kernel 394
2.6.13-rc3 patch 12 in-kernel 442
2.6.13-rc3 patch 1 in-kernel 450
2.6.13-rc3 in-kernel 395
2.6.13-rc2 patch 1 in-kernel 409
2.6.13-rc1 patch 1 in-kernel 408
2.6.12.5-lustre in-kernel 399
2.6.12.5 patch 1 in-kernel 464
2.6.12.5 in-kernel 402
2.6.12 in-kernel 406
2.6.12-rc6 patch 1 in-kernel 470
2.6.12-rc6 in-kernel 407
2.6.12-rc5 in-kernel 405
2.6.12-rc5 patch 1 in-kernel 474
2.6.12-rc4 in-kernel 470
2.6.12-rc3 in-kernel 466
2.6.12-rc2 in-kernel 469
2.6.12-rc1 in-kernel 466
2.6.11 in-kernel 464
2.6.11 svn3687 464
2.6.9-11.ELsmp svn3513 425 (Woody's results, 3.6Ghz EM64T)
More information about the ewg
mailing list