[openfabrics-ewg] IPoIB/SDP performance graphs for PCI-E RHEL4 U2 i686 Dell PE1850

Matt L. Leininger mlleini at ca.sandia.gov
Thu Mar 30 10:23:14 PST 2006


On Wed, 2006-03-29 at 23:30 -0800, Scott Weitzenkamp (sweitzen) wrote:
> We've never been able to get very good IPoIB throughput on these
> systems (dual 3.0 GHz EMT64 CPUs).  SDP performance seems very good,
> though.
>  
> We're using LionCub Rev C HCAs.

  I've attached my data for IPoIB performance for a variety of kernels.
>  
> To summarize:
>  
> min SDP latency: 26 usec
> max SDP throughput: 7.2 Gb/sec
> min IPoIB latency: 32 usec
> max IPoIB throughput: 1.7 Gb/sec

  IPoIB throughput looks really low.  Are you sure you have the PCIe HCA
in the PCIe 8X slot?  I've seen poor throughput on the 1850's when you
have the HCA on the PCIe 4X slot.

	- Matt
>  
> Scott
> email message attachment
> > -------- Forwarded Message --------
> > From: Scott Weitzenkamp (sweitzen) <sweitzen at cisco.com>
> > To: Scott Weitzenkamp (sweitzen) <sweitzen at cisco.com>
> > Subject: Chassis TopspinOS-2.5.0 and Host IBED Test Results - Total:
> > 15; Pass 9; Fail: 1; Skip: 5
> > Date: Tue, 28 Mar 2006 10:31:58 -0800
> > 
> > 
> > 
> > Protest Run Results
> > 
> > Chassis Branch: TopspinOS-2.5.0
> > Chassis Build: build251
> > IB Hosts: svbu-qa1850-1 svbu-qa1850-2
> > IB Hosts OS: openib openib
> > Host Branch: IBED
> > Host Build: buildrc2
> > Topology: /data/home/scott/cluster_switch.main/qa/tests/smoke/Pb7.topo
> > Logs: /data/home/scott/builds/TopspinOS-2.5.0/build251/protest/Pb7/032806_092425
> > Logs URL:
> > http://svbu-borg.cisco.com/~releng/data/home/scott/builds/TopspinOS-2.5.0/build251/protest/Pb7/032806_092425
> > 
> > 
> > Scenario file: Netperf2Hosts.scen
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 1 Bytes
> > Throughput: 1.69 Mbits/sec
> > Transactions Per Second: 211250.00
> > Client CPU Usage: 59.44%
> > Server CPU Usage: 41.31%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     : 1429: 3580: 1801132: 3726221: 65373: 111088: 131126:
> > 89377: 123308: 47340
> > TEN_USEC      :    0: 249551: 3390:   65:   33:   32:    5:    5:
> > 2:    0
> > HUNDRED_USEC  :    0:    2:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      6353059
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 2 Bytes
> > Throughput: 3.39 Mbits/sec
> > Transactions Per Second: 211875.00
> > Client CPU Usage: 60.12%
> > Server CPU Usage: 41.68%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     : 1467: 3530: 1818158: 3709742: 65172: 114730: 129779:
> > 87955: 118142: 48712
> > TEN_USEC      :    0: 251100: 3874:   92:   42:   43:    8:    4:
> > 2:    4
> > HUNDRED_USEC  :    0:   17:    1:    0:    0:    0:    1:    1:
> > 2:    1
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      6352579
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 4 Bytes
> > Throughput: 6.65 Mbits/sec
> > Transactions Per Second: 207812.50
> > Client CPU Usage: 58.96%
> > Server CPU Usage: 41.68%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     : 1072: 3350: 1413783: 3981313: 72353: 107013: 125753:
> > 92119: 107119: 59092
> > TEN_USEC      :    0: 271790: 3701:   59:   32:   33:    7:    7:
> > 3:    1
> > HUNDRED_USEC  :    0:    4:    1:    0:    0:    1:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      6238606
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 8 Bytes
> > Throughput: 13.48 Mbits/sec
> > Transactions Per Second: 210625.00
> > Client CPU Usage: 59.44%
> > Server CPU Usage: 41.48%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     : 1343: 3337: 1704464: 3783969: 63760: 113136: 132428:
> > 88706: 114000: 52924
> > TEN_USEC      :    0: 256446: 3603:   78:   55:   49:    9:    5:
> > 2:    2
> > HUNDRED_USEC  :    0:   14:    1:    0:    0:    0:    0:    2:
> > 0:    1
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      6318334
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 16 Bytes
> > Throughput: 26.93 Mbits/sec
> > Transactions Per Second: 210390.62
> > Client CPU Usage: 58.87%
> > Server CPU Usage: 41.36%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     : 1364: 3510: 1653763: 3842019: 67736: 106184: 124928:
> > 86686: 116393: 51734
> > TEN_USEC      :    0: 255041: 3712:   82:   50:   38:    7:    4:
> > 3:    1
> > HUNDRED_USEC  :    0:   12:    0:    0:    0:    0:    1:    3:
> > 0:    1
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      6313272
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 32 Bytes
> > Throughput: 53.71 Mbits/sec
> > Transactions Per Second: 209804.69
> > Client CPU Usage: 59.39%
> > Server CPU Usage: 41.39%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     : 1267: 3403: 1604459: 3863032: 78319: 112351: 124566:
> > 88437: 113106: 54205
> > TEN_USEC      :    0: 248769: 3625:  101:   46:   47:    8:    3:
> > 0:    1
> > HUNDRED_USEC  :    0:   15:    0:    0:    0:    0:    0:    2:
> > 1:    1
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      6295764
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 64 Bytes
> > Throughput: 107.15 Mbits/sec
> > Transactions Per Second: 209277.34
> > Client CPU Usage: 58.39%
> > Server CPU Usage: 41.60%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     : 1281: 3400: 1531488: 3923007: 82964: 103078: 118255:
> > 88823: 113603: 52507
> > TEN_USEC      :    0: 256915: 4117:   70:   42:   36:   14:    5:
> > 0:    2
> > HUNDRED_USEC  :    0:   12:    0:    0:    0:    0:    2:    1:
> > 1:    1
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      6279624
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 128 Bytes
> > Throughput: 211.76 Mbits/sec
> > Transactions Per Second: 206796.88
> > Client CPU Usage: 58.84%
> > Server CPU Usage: 41.68%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     : 1075: 3132: 1350939: 3991296: 109369: 99393: 124286:
> > 95902: 103881: 55857
> > TEN_USEC      :    0: 264929: 4649:   86:   42:   50:    8:    5:
> > 2:    0
> > HUNDRED_USEC  :    0:   16:    0:    0:    0:    0:    1:    2:
> > 1:    1
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      6204922
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 256 Bytes
> > Throughput: 406.19 Mbits/sec
> > Transactions Per Second: 198334.96
> > Client CPU Usage: 59.16%
> > Server CPU Usage: 41.98%
> > Average Latency: 5.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     : 1045: 2877: 872417: 3798081: 537624: 73290: 92262:
> > 86699: 103777: 65267
> > TEN_USEC      :    0: 311156: 6482:  104:   39:   28:    9:    2:
> > 2:    3
> > HUNDRED_USEC  :    0:    6:    1:    0:    0:    1:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      5951172
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 512 Bytes
> > Throughput: 796.12 Mbits/sec
> > Transactions Per Second: 194365.23
> > Client CPU Usage: 58.58%
> > Server CPU Usage: 41.61%
> > Average Latency: 5.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :  757: 2666: 623740: 3792428: 688974: 63564: 89300:
> > 89378: 95724: 74757
> > TEN_USEC      :    0: 302772: 8853:  105:   49:   52:    9:    3:
> > 3:    1
> > HUNDRED_USEC  :    0:   15:    1:    0:    0:    0:    1:    2:
> > 1:    2
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      5833157
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 1024 Bytes
> > Throughput: 1527.45 Mbits/sec
> > Transactions Per Second: 186456.30
> > Client CPU Usage: 58.41%
> > Server CPU Usage: 42.71%
> > Average Latency: 5.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :  541: 2631: 443650: 3387936: 1079669: 39998: 78817:
> > 86019: 67381: 81721
> > TEN_USEC      :    0: 294238: 31632:  202:   65:   52:   16:    6:
> > 9:    3
> > HUNDRED_USEC  :    0:    5:    1:    0:    0:    1:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    2:    2:    0:    0:    1:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      5594598
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 2048 Bytes
> > Throughput: 2734.36 Mbits/sec
> > Transactions Per Second: 166892.09
> > Client CPU Usage: 58.26%
> > Server CPU Usage: 45.21%
> > Average Latency: 5.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :  124: 1340: 95967: 1860562: 2155143: 224542: 50572:
> > 99103: 66502: 67403
> > TEN_USEC      :    0: 323390: 62517:  333:   49:   48:   17:    5:
> > 5:    2
> > HUNDRED_USEC  :    0:   16:    1:    0:    0:    0:    0:    1:
> > 2:    3
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    1:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      5007648
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 4096 Bytes
> > Throughput: 4489.29 Mbits/sec
> > Transactions Per Second: 137002.26
> > Client CPU Usage: 55.88%
> > Server CPU Usage: 45.86%
> > Average Latency: 7.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :   75:  959: 2029: 678000: 1527505: 828611: 423430:
> > 161574: 106401: 30767
> > TEN_USEC      :    0: 116232: 222718: 12330:  194:   52:   28:   14:
> > 7:    5
> > HUNDRED_USEC  :    0:   23:    3:    0:    0:    1:    1:    3:
> > 2:    1
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      4110965
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 8192 Bytes
> > Throughput: 5472.24 Mbits/sec
> > Transactions Per Second: 83499.76
> > Client CPU Usage: 57.81%
> > Server CPU Usage: 47.18%
> > Average Latency: 11.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    5:  177:  564: 107231: 467630: 370967:
> > 323937: 179675: 226400
> > TEN_USEC      :    0: 488757: 209730: 115716: 14183:  277:   49:
> > 41:   16:   11
> > HUNDRED_USEC  :    0:   33:    2:    0:    0:    0:    0:    6:
> > 1:    1
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      2505409
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 16384 Bytes
> > Throughput: 6514.62 Mbits/sec
> > Transactions Per Second: 49702.61
> > Client CPU Usage: 53.19%
> > Server CPU Usage: 49.31%
> > Average Latency: 20.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:   38:  171:  627: 169116:
> > 87414: 45168
> > TEN_USEC      :    0: 647216: 267422: 199193: 63226: 10638:  894:
> > 101:   29:   22
> > HUNDRED_USEC  :    0:   56:    2:    5:    0:    0:    1:    1:
> > 1:    1
> > UNIT_MSEC     :    0:    2:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      1491344
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 32768 Bytes
> > Throughput: 7089.57 Mbits/sec
> > Transactions Per Second: 27044.56
> > Client CPU Usage: 51.46%
> > Server CPU Usage: 50.81%
> > Average Latency: 36.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    9
> > TEN_USEC      :    0: 123793: 176361: 172605: 192871: 113952: 25354:
> > 3853:  551:  127
> > HUNDRED_USEC  :    0: 1998:   13:    7:    0:    0:    0:    0:
> > 4:    2
> > UNIT_MSEC     :    0:    3:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      811503
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 65536 Bytes
> > Throughput: 7139.25 Mbits/sec
> > Transactions Per Second: 13617.04
> > Client CPU Usage: 49.24%
> > Server CPU Usage: 50.63%
> > Average Latency: 73.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:  633: 17340: 13115: 47904: 170791:
> > 81591: 34231: 12930
> > HUNDRED_USEC  :    0: 29969:   71:    5:    2:    0:    0:    2:
> > 1:    0
> > UNIT_MSEC     :    0:    2:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      408587
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 131072 Bytes
> > Throughput: 7209.77 Mbits/sec
> > Transactions Per Second: 6875.77
> > Client CPU Usage: 49.09%
> > Server CPU Usage: 50.43%
> > Average Latency: 145.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    1:    5:
> > 12:  168
> > HUNDRED_USEC  :    0: 187800: 18295:   12:    4:    1:    0:    0:
> > 1:    2
> > UNIT_MSEC     :    0:    6:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      206307
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 262144 Bytes
> > Throughput: 7132.63 Mbits/sec
> > Transactions Per Second: 3401.10
> > Client CPU Usage: 47.68%
> > Server CPU Usage: 50.11%
> > Average Latency: 293.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:   36: 56429: 45513:   60:    4:    3:    0:
> > 0:    2
> > UNIT_MSEC     :    0:    4:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      102051
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 524288 Bytes
> > Throughput: 7160.12 Mbits/sec
> > Transactions Per Second: 1707.11
> > Client CPU Usage: 47.33%
> > Server CPU Usage: 50.31%
> > Average Latency: 585.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:  472: 36223: 14451:   62:
> > 6:    1
> > UNIT_MSEC     :    0:    8:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      51223
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 1048576 Bytes
> > Throughput: 7182.07 Mbits/sec
> > Transactions Per Second: 856.17
> > Client CPU Usage: 47.98%
> > Server CPU Usage: 50.46%
> > Average Latency: 1167.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0: 25685:    3:    0:    0:    1:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      25689
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 2097152 Bytes
> > Throughput: 7189.94 Mbits/sec
> > Transactions Per Second: 428.55
> > Client CPU Usage: 47.29%
> > Server CPU Usage: 51.39%
> > Average Latency: 2332.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0: 12850:    8:    0:    1:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      12859
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 4194304 Bytes
> > Throughput: 7196.26 Mbits/sec
> > Transactions Per Second: 214.47
> > Client CPU Usage: 47.31%
> > Server CPU Usage: 50.76%
> > Average Latency: 4662.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0: 6425:   10:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      6435
> > 
> > IP.Performance.Netperf.SDP2SDP.TCP_STREAM --> PASS
> > ###TEST-D: TCP_RR - time out while waiting for prompt after running
> > netperf
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 1,1
> > Throughput: 0.31/0.31 Mbits/sec
> > Transactions Per Second: 19074.74
> > Client CPU Usage: 20.50%
> > Server CPU Usage: 18.68%
> > Average Latency: 26.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    1:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    1:    1: 49574: 516912: 5488:  178:
> > 94:   41
> > HUNDRED_USEC  :    0:   49:    4:    1:    0:    0:    0:    0:
> > 1:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      572345
> > 
> > ###TEST-D: TCP_RR - time out while waiting for prompt after running
> > netperf
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 2,2
> > Throughput: 0.61/0.61 Mbits/sec
> > Transactions Per Second: 19109.44
> > Client CPU Usage: 20.82%
> > Server CPU Usage: 18.97%
> > Average Latency: 26.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    2: 59249: 508394: 5366:  193:
> > 106:   29
> > HUNDRED_USEC  :    0:   47:    2:    2:    0:    0:    1:    0:
> > 0:    1
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      573392
> > 
> > ###TEST-D: TCP_RR - time out while waiting for prompt after running
> > netperf
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 4,4
> > Throughput: 1.22/1.22 Mbits/sec
> > Transactions Per Second: 19001.32
> > Client CPU Usage: 22.10%
> > Server CPU Usage: 20.03%
> > Average Latency: 26.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0: 13262: 550244: 6264:  155:
> > 106:   38
> > HUNDRED_USEC  :    0:   56:    1:    3:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      570129
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 8,8
> > Throughput: 2.44/2.44 Mbits/sec
> > Transactions Per Second: 19087.51
> > Client CPU Usage: 20.30%
> > Server CPU Usage: 18.43%
> > Average Latency: 26.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    1: 45552: 517309: 9386:  294:
> > 104:   29
> > HUNDRED_USEC  :    0:   54:    4:    1:    0:    0:    0:    0:
> > 0:    1
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      572735
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 16,16
> > Throughput: 4.88/4.88 Mbits/sec
> > Transactions Per Second: 19081.21
> > Client CPU Usage: 20.26%
> > Server CPU Usage: 18.58%
> > Average Latency: 26.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0: 46348: 519429: 6348:  214:
> > 79:   46
> > HUNDRED_USEC  :    0:   53:    6:    1:    1:    0:    2:    0:
> > 1:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      572528
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 32,32
> > Throughput: 9.75/9.75 Mbits/sec
> > Transactions Per Second: 19046.54
> > Client CPU Usage: 20.63%
> > Server CPU Usage: 18.85%
> > Average Latency: 26.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    1:    0: 30002: 535394: 5747:  156:
> > 96:   32
> > HUNDRED_USEC  :    0:   61:    3:    0:    0:    1:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      571493
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 64,64
> > Throughput: 19.45/19.45 Mbits/sec
> > Transactions Per Second: 18996.25
> > Client CPU Usage: 21.95%
> > Server CPU Usage: 20.03%
> > Average Latency: 26.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    1: 13818: 549420: 6398:  166:
> > 82:   39
> > HUNDRED_USEC  :    0:   51:    3:    3:    0:    0:    1:    1:
> > 1:    1
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      569985
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 128,128
> > Throughput: 38.73/38.73 Mbits/sec
> > Transactions Per Second: 18912.96
> > Client CPU Usage: 24.26%
> > Server CPU Usage: 22.57%
> > Average Latency: 26.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    1:    3: 3757: 554740: 8578:  205:
> > 104:   34
> > HUNDRED_USEC  :    0:   55:    4:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    1:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      567482
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 256,256
> > Throughput: 76.31/76.31 Mbits/sec
> > Transactions Per Second: 18629.90
> > Client CPU Usage: 27.60%
> > Server CPU Usage: 25.58%
> > Average Latency: 26.5 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0: 2449: 539867: 16217:  268:
> > 95:   43
> > HUNDRED_USEC  :    0:   50:    3:    1:    0:    1:    0:    1:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      558995
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 512,512
> > Throughput: 148.64/148.64 Mbits/sec
> > Transactions Per Second: 18144.48
> > Client CPU Usage: 24.61%
> > Server CPU Usage: 22.77%
> > Average Latency: 27.5 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:  808: 504640: 38411:  357:
> > 117:   47
> > HUNDRED_USEC  :    0:   56:    2:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      544438
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 1024,1024
> > Throughput: 283.92/283.92 Mbits/sec
> > Transactions Per Second: 17329.03
> > Client CPU Usage: 24.45%
> > Server CPU Usage: 22.93%
> > Average Latency: 28.5 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    1:    9: 465727: 53008:  946:
> > 105:   90
> > HUNDRED_USEC  :    0:   63:    4:    0:    0:    2:    0:    1:
> > 0:    1
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      519957
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 2048,2048
> > Throughput: 549.59/549.59 Mbits/sec
> > Transactions Per Second: 16772.13
> > Client CPU Usage: 21.96%
> > Server CPU Usage: 20.53%
> > Average Latency: 29.5 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    1:    1: 421409: 77980: 3534:
> > 153:   93
> > HUNDRED_USEC  :    0:   73:    2:    0:    0:    0:    0:    1:
> > 0:    1
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      503248
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 4096,4096
> > Throughput: 949.86/949.86 Mbits/sec
> > Transactions Per Second: 14493.71
> > Client CPU Usage: 22.49%
> > Server CPU Usage: 20.96%
> > Average Latency: 34.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    1:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    1:    8: 370233: 62268:
> > 2079:  136
> > HUNDRED_USEC  :    0:  142:    3:    0:    0:    1:    0:    1:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      434873
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 8192,8192
> > Throughput: 1603.56/1603.56 Mbits/sec
> > Transactions Per Second: 12234.23
> > Client CPU Usage: 21.35%
> > Server CPU Usage: 20.78%
> > Average Latency: 40.5 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    1:    0:   11: 276533:
> > 55119: 10813
> > HUNDRED_USEC  :    0: 24603:    8:    4:    1:    1:    1:    0:
> > 1:    2
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      367098
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 16384,16384
> > Throughput: 2320.31/2320.31 Mbits/sec
> > Transactions Per Second: 8851.27
> > Client CPU Usage: 27.71%
> > Server CPU Usage: 26.08%
> > Average Latency: 56.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 1: 92078
> > HUNDRED_USEC  :    0: 173491:   15:    0:    0:    0:    0:    1:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      265586
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 32768,32768
> > Throughput: 3056.68/3056.68 Mbits/sec
> > Transactions Per Second: 5830.15
> > Client CPU Usage: 31.51%
> > Server CPU Usage: 31.31%
> > Average Latency: 85.5 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    1
> > HUNDRED_USEC  :    0: 167269: 7658:    2:    0:    0:    0:    1:
> > 2:    1
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      174934
> > 
> > ###TEST-D: TCP_RR - time out while waiting for prompt after running
> > netperf
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 65536,65536
> > Throughput: 4218.71/4218.71 Mbits/sec
> > Transactions Per Second: 4023.28
> > Client CPU Usage: 37.73%
> > Server CPU Usage: 36.54%
> > Average Latency: 124.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0: 120507:  192:   10:    0:    0:    0:
> > 2:    2
> > UNIT_MSEC     :    0:    2:    1:    2:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      120718
> > 
> > ###TEST-D: TCP_RR - time out while waiting for prompt after running
> > netperf
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 131072,131072
> > Throughput: 4993.36/4993.36 Mbits/sec
> > Transactions Per Second: 2381.02
> > Client CPU Usage: 41.09%
> > Server CPU Usage: 40.58%
> > Average Latency: 209.5 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0: 5703: 65707:   19:    5:    1:
> > 1:    0
> > UNIT_MSEC     :    0:    6:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      71442
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 262144,262144
> > Throughput: 5546.63/5546.63 Mbits/sec
> > Transactions Per Second: 1322.42
> > Client CPU Usage: 44.56%
> > Server CPU Usage: 44.21%
> > Average Latency: 378.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:    0:    0:    0: 39543:
> > 117:    9
> > UNIT_MSEC     :    0:   11:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      39680
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 524288,524288
> > Throughput: 5866.91/5866.91 Mbits/sec
> > Transactions Per Second: 699.39
> > Client CPU Usage: 46.18%
> > Server CPU Usage: 40.50%
> > Average Latency: 714.5 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0: 20978:    7:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      20985
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 1048576,1048576
> > Throughput: 5797.37/5797.37 Mbits/sec
> > Transactions Per Second: 345.55
> > Client CPU Usage: 47.22%
> > Server CPU Usage: 47.06%
> > Average Latency: 1446.5 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0: 10252:  113:    1:    0:    1:    1:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      10368
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 2097152,2097152
> > Throughput: 5536.15/5536.15 Mbits/sec
> > Transactions Per Second: 164.99
> > Client CPU Usage: 45.58%
> > Server CPU Usage: 45.49%
> > Average Latency: 3029.5 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:   11: 4936:    3:
> > 0:    1
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      4951
> > 
> > ###TEST-D: Netperf Test sdp2sdp from svbu-qa1850-2 to svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 4194304,4194304
> > Throughput: 5398.91/5398.91 Mbits/sec
> > Transactions Per Second: 80.45
> > Client CPU Usage: 44.99%
> > Server CPU Usage: 44.91%
> > Average Latency: 6213.5 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0: 2414:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      2414
> > 
> > IP.Performance.Netperf.SDP2SDP.TCP_RR --> PASS
> > IP.Performance.Netperf.SDP2SDP.UDP_STREAM --> PASS
> > ###TEST-W: sdp2sdp - time out while running netperf
> > ###TEST-E: TCP_CC Test sdp2sdp failed
> > IP.Performance.Netperf.SDP2SDP.TCP_CC --> FAIL
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 1 Bytes
> > Throughput: 1.63 Mbits/sec
> > Transactions Per Second: 203750.00
> > Client CPU Usage: 56.57%
> > Server CPU Usage: 33.38%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     : 1546: 3620: 4289558: 767615: 16063: 52213: 202820:
> > 268889: 54344: 35831
> > TEN_USEC      :    0: 409296: 4574:  132:   22:   55:   22:   15:
> > 3:    1
> > HUNDRED_USEC  :    0:   10:    0:    1:    0:    1:    0:    1:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      6106632
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 2 Bytes
> > Throughput: 3.27 Mbits/sec
> > Transactions Per Second: 204375.00
> > Client CPU Usage: 63.81%
> > Server CPU Usage: 30.80%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     : 1786: 3706: 4203159: 664997: 15828: 104196: 416311:
> > 211066: 37292: 74208
> > TEN_USEC      :    0: 394453: 3465:   86:   21:   48:   12:    6:
> > 2:    5
> > HUNDRED_USEC  :    0:    7:    1:    0:    0:    1:    0:    0:
> > 1:    2
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      6130659
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 4 Bytes
> > Throughput: 6.42 Mbits/sec
> > Transactions Per Second: 200625.00
> > Client CPU Usage: 63.92%
> > Server CPU Usage: 31.81%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     : 1730: 3426: 3759926: 922474: 20583: 123232: 447747:
> > 207321: 51995: 74624
> > TEN_USEC      :    0: 402171: 4214:   88:   18:   54:   26:   13:
> > 4:    1
> > HUNDRED_USEC  :    0:   12:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      6019659
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 8 Bytes
> > Throughput: 13.06 Mbits/sec
> > Transactions Per Second: 204062.50
> > Client CPU Usage: 62.71%
> > Server CPU Usage: 32.91%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     : 2315: 4019: 4163727: 761681: 16299: 97466: 335215:
> > 233671: 44906: 51181
> > TEN_USEC      :    0: 408810: 4624:  144:   39:   85:   30:    7:
> > 7:   13
> > HUNDRED_USEC  :    0:   13:    0:    0:    1:    0:    0:    2:
> > 0:    2
> > UNIT_MSEC     :    0:    3:    1:    0:    1:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      6124262
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 16 Bytes
> > Throughput: 25.97 Mbits/sec
> > Transactions Per Second: 202890.62
> > Client CPU Usage: 63.64%
> > Server CPU Usage: 33.03%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     : 1869: 3552: 4088848: 772860: 13470: 81621: 402002:
> > 203872: 36523: 44314
> > TEN_USEC      :    0: 434566: 4204:   93:   17:   56:   21:   13:
> > 3:    1
> > HUNDRED_USEC  :    0:   10:    0:    0:    0:    0:    0:    2:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      6087917
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 32 Bytes
> > Throughput: 51.95 Mbits/sec
> > Transactions Per Second: 202929.69
> > Client CPU Usage: 58.57%
> > Server CPU Usage: 32.10%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     : 4513: 5579: 4103364: 900271: 19704: 61814: 248887:
> > 229582: 58390: 19764
> > TEN_USEC      :    0: 429313: 7754:  144:   16:   60:   33:    8:
> > 2:    3
> > HUNDRED_USEC  :    0:   12:    0:    1:    1:    0:    0:    3:
> > 0:    0
> > UNIT_MSEC     :    0:    1:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      6089219
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 64 Bytes
> > Throughput: 115.41 Mbits/sec
> > Transactions Per Second: 225410.16
> > Client CPU Usage: 57.74%
> > Server CPU Usage: 25.76%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     : 3579: 5232: 4623697: 1130479: 24339: 80864: 266110:
> > 234544: 51826: 12985
> > TEN_USEC      :    0: 325689: 3738:  102:   22:   42:    8:    7:
> > 6:    3
> > HUNDRED_USEC  :    0:   13:    1:    1:    1:    0:    0:    1:
> > 0:    1
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      6763290
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 128 Bytes
> > Throughput: 217.21 Mbits/sec
> > Transactions Per Second: 212119.14
> > Client CPU Usage: 57.51%
> > Server CPU Usage: 29.46%
> > Average Latency: 4.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     : 3241: 4978: 3727165: 1550300: 37366: 89538: 300181:
> > 221016: 78597: 6660
> > TEN_USEC      :    0: 340606: 4953:  142:   27:   39:   14:    2:
> > 6:    8
> > HUNDRED_USEC  :    0:   15:    3:    1:    0:    0:    0:    1:
> > 1:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      6364860
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 256 Bytes
> > Throughput: 305.78 Mbits/sec
> > Transactions Per Second: 149306.64
> > Client CPU Usage: 61.26%
> > Server CPU Usage: 37.09%
> > Average Latency: 6.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     : 1042: 2138: 1410482: 1478485: 52093: 52092: 495419:
> > 252723: 172298: 66955
> > TEN_USEC      :    0: 442273: 52891:  810:   34:   40:   21:   16:
> > 8:    4
> > HUNDRED_USEC  :    0:   18:    2:    3:    1:    0:    0:    2:
> > 1:    1
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      4479852
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 512 Bytes
> > Throughput: 455.26 Mbits/sec
> > Transactions Per Second: 111147.46
> > Client CPU Usage: 62.72%
> > Server CPU Usage: 39.23%
> > Average Latency: 8.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :   72:  835: 193755: 1321135: 101822: 18518: 337330:
> > 418120: 192314: 181050
> > TEN_USEC      :    0: 385439: 180390: 4047:   93:   47:   25:   20:
> > 17:    5
> > HUNDRED_USEC  :    0:   17:    2:    0:    0:    0:    0:    2:
> > 2:    0
> > UNIT_MSEC     :    0:    1:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      3335058
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 1024 Bytes
> > Throughput: 628.04 Mbits/sec
> > Transactions Per Second: 76665.04
> > Client CPU Usage: 62.91%
> > Server CPU Usage: 42.84%
> > Average Latency: 13.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    7:   57:  367: 155083: 418348: 17624: 12431:
> > 177177: 180002: 171892
> > TEN_USEC      :    0: 883453: 269577: 12848: 1288:   75:   43:   19:
> > 20:   10
> > HUNDRED_USEC  :    0:   24:    1:    1:    0:    2:    1:    1:
> > 2:    1
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      2300354
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 2048 Bytes
> > Throughput: 794.88 Mbits/sec
> > Transactions Per Second: 48515.62
> > Client CPU Usage: 59.67%
> > Server CPU Usage: 44.81%
> > Average Latency: 20.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    1:   28:  687:  217: 2008:
> > 111008: 73027
> > TEN_USEC      :    0: 695909: 462891: 102577: 6828:  331:   98:
> > 50:   30:   19
> > HUNDRED_USEC  :    0:   39:    5:    2:    1:    0:    0:    0:
> > 1:    4
> > UNIT_MSEC     :    0:    1:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      1455762
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 4096 Bytes
> > Throughput: 995.45 Mbits/sec
> > Transactions Per Second: 30378.72
> > Client CPU Usage: 56.21%
> > Server CPU Usage: 45.99%
> > Average Latency: 32.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    1:    0:    0:    0:    0:    0:    1:  435:
> > 1504:  186
> > TEN_USEC      :    0: 121123: 284176: 362458: 130712: 9339: 1050:
> > 181:   81:   58
> > HUNDRED_USEC  :    0:  200:   13:    4:    0:    0:    1:    3:
> > 2:    0
> > UNIT_MSEC     :    0:    1:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      911529
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 8192 Bytes
> > Throughput: 1219.41 Mbits/sec
> > Transactions Per Second: 18606.72
> > Client CPU Usage: 53.38%
> > Server CPU Usage: 48.31%
> > Average Latency: 53.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0: 1334: 11629: 70629: 154925: 232617: 65151:
> > 18254: 1736:  224
> > HUNDRED_USEC  :    0: 1793:   16:    5:    0:    1:    0:    1:
> > 1:    1
> > UNIT_MSEC     :    0:    3:    1:    1:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      558322
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 16384 Bytes
> > Throughput: 1420.25 Mbits/sec
> > Transactions Per Second: 10835.65
> > Client CPU Usage: 51.88%
> > Server CPU Usage: 49.01%
> > Average Latency: 92.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:   54:   43:   59:   99: 3216: 39170:
> > 125595: 112899
> > HUNDRED_USEC  :    0: 43950:   33:    8:    0:    0:    0:    0:
> > 3:    3
> > UNIT_MSEC     :    0:    2:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      325134
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 32768 Bytes
> > Throughput: 1593.83 Mbits/sec
> > Transactions Per Second: 6079.98
> > Client CPU Usage: 51.56%
> > Server CPU Usage: 49.53%
> > Average Latency: 164.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    2:    0:
> > 3:    1
> > HUNDRED_USEC  :    0: 180985: 1410:   15:    8:    0:    1:    0:
> > 0:    2
> > UNIT_MSEC     :    0:    4:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      182431
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 65536 Bytes
> > Throughput: 1701.94 Mbits/sec
> > Transactions Per Second: 3246.19
> > Client CPU Usage: 51.74%
> > Server CPU Usage: 49.69%
> > Average Latency: 307.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0: 39832: 57432:  122:   10:    2:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    8:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      97406
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 131072 Bytes
> > Throughput: 1719.41 Mbits/sec
> > Transactions Per Second: 1639.76
> > Client CPU Usage: 49.88%
> > Server CPU Usage: 49.24%
> > Average Latency: 609.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:    0: 19369: 29437:  373:
> > 9:    7
> > UNIT_MSEC     :    0:    7:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      49202
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 262144 Bytes
> > Throughput: 1721.64 Mbits/sec
> > Transactions Per Second: 820.94
> > Client CPU Usage: 49.39%
> > Server CPU Usage: 49.28%
> > Average Latency: 1217.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0: 24624:    7:    1:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      24632
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 524288 Bytes
> > Throughput: 1722.80 Mbits/sec
> > Transactions Per Second: 410.75
> > Client CPU Usage: 49.01%
> > Server CPU Usage: 49.13%
> > Average Latency: 2434.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0: 12317:    7:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      12324
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 1048576 Bytes
> > Throughput: 1726.26 Mbits/sec
> > Transactions Per Second: 205.79
> > Client CPU Usage: 48.94%
> > Server CPU Usage: 49.18%
> > Average Latency: 4859.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0: 6048:  123:    3:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      6174
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 2097152 Bytes
> > Throughput: 1730.01 Mbits/sec
> > Transactions Per Second: 103.12
> > Client CPU Usage: 48.56%
> > Server CPU Usage: 49.26%
> > Average Latency: 9696.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0: 3042
> > TEN_MSEC      :    0:   52:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      3094
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 4194304 Bytes
> > Throughput: 1729.43 Mbits/sec
> > Transactions Per Second: 51.54
> > Client CPU Usage: 48.79%
> > Server CPU Usage: 48.94%
> > Average Latency: 19404.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0: 1509:   37:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      1546
> > 
> > IP.Performance.Netperf.IPoIB2IPoIB.TCP_STREAM --> PASS
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 1,1
> > Throughput: 0.25/0.25 Mbits/sec
> > Transactions Per Second: 15500.66
> > Client CPU Usage: 29.66%
> > Server CPU Usage: 27.52%
> > Average Latency: 32.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    1:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0: 1610: 446151: 16807:
> > 251:  145
> > HUNDRED_USEC  :    0:  126:    3:    1:    1:    1:    1:    0:
> > 0:    1
> > UNIT_MSEC     :    0:    1:    1:    2:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      465103
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 2,2
> > Throughput: 0.50/0.50 Mbits/sec
> > Transactions Per Second: 15523.54
> > Client CPU Usage: 28.61%
> > Server CPU Usage: 28.16%
> > Average Latency: 32.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    1:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    1:    0:    1: 1854: 446997: 16524:
> > 194:   90
> > HUNDRED_USEC  :    0:  123:    2:    0:    1:    0:    0:    0:
> > 1:    0
> > UNIT_MSEC     :    0:    1:    1:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      465791
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 4,4
> > Throughput: 0.99/0.99 Mbits/sec
> > Transactions Per Second: 15448.48
> > Client CPU Usage: 29.90%
> > Server CPU Usage: 27.95%
> > Average Latency: 32.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    1:    1: 1277: 443834: 18020:
> > 192:  101
> > HUNDRED_USEC  :    0:  106:    3:    0:    2:    0:    0:    0:
> > 2:    2
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      463541
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 8,8
> > Throughput: 1.98/1.98 Mbits/sec
> > Transactions Per Second: 15500.10
> > Client CPU Usage: 28.83%
> > Server CPU Usage: 27.20%
> > Average Latency: 32.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0: 1704: 444472: 18430:
> > 264:  105
> > HUNDRED_USEC  :    0:  102:    3:    1:    0:    1:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      465082
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 16,16
> > Throughput: 3.94/3.94 Mbits/sec
> > Transactions Per Second: 15389.45
> > Client CPU Usage: 30.53%
> > Server CPU Usage: 28.56%
> > Average Latency: 32.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0: 1147: 440439: 19710:
> > 267:   91
> > HUNDRED_USEC  :    0:   97:    4:    1:    0:    1:    0:    0:
> > 1:    1
> > UNIT_MSEC     :    0:    1:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      461760
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 32,32
> > Throughput: 7.86/7.86 Mbits/sec
> > Transactions Per Second: 15361.10
> > Client CPU Usage: 30.58%
> > Server CPU Usage: 28.95%
> > Average Latency: 32.5 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    1:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:  906: 438581: 20971:
> > 253:  105
> > HUNDRED_USEC  :    0:  104:    0:    0:    0:    1:    0:    1:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      460923
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 64,64
> > Throughput: 15.66/15.66 Mbits/sec
> > Transactions Per Second: 15290.80
> > Client CPU Usage: 32.06%
> > Server CPU Usage: 30.11%
> > Average Latency: 32.5 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:  622: 433236: 24341:
> > 378:  105
> > HUNDRED_USEC  :    0:  114:    2:    1:    0:    0:    0:    1:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      458800
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 128,128
> > Throughput: 30.83/30.83 Mbits/sec
> > Transactions Per Second: 15054.27
> > Client CPU Usage: 26.76%
> > Server CPU Usage: 25.05%
> > Average Latency: 33.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:  304: 416919: 33708:
> > 512:   99
> > HUNDRED_USEC  :    0:  158:    3:    0:    0:    0:    0:    1:
> > 0:    0
> > UNIT_MSEC     :    0:    1:    0:    1:    1:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      451707
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 256,256
> > Throughput: 60.55/60.55 Mbits/sec
> > Transactions Per Second: 14782.89
> > Client CPU Usage: 30.49%
> > Server CPU Usage: 29.31%
> > Average Latency: 33.5 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    1:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    1:    0:    0:    0:   25: 394804: 47832:
> > 635:   91
> > HUNDRED_USEC  :    0:  160:    3:    1:    0:    0:    0:    1:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      443554
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 512,512
> > Throughput: 117.76/117.76 Mbits/sec
> > Transactions Per Second: 14375.47
> > Client CPU Usage: 28.15%
> > Server CPU Usage: 26.60%
> > Average Latency: 34.5 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    1:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    3: 363365: 66517:
> > 1112:  160
> > HUNDRED_USEC  :    0:  175:    4:    0:    1:    0:    0:    1:
> > 0:    1
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      431340
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 1024,1024
> > Throughput: 222.20/222.20 Mbits/sec
> > Transactions Per Second: 13561.90
> > Client CPU Usage: 30.00%
> > Server CPU Usage: 28.76%
> > Average Latency: 36.5 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0: 1685: 394238:
> > 10532:  269
> > HUNDRED_USEC  :    0:  197:    3:    1:    0:    0:    2:    0:
> > 0:    1
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      406928
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 2048,2048
> > Throughput: 305.13/305.13 Mbits/sec
> > Transactions Per Second: 9311.71
> > Client CPU Usage: 38.59%
> > Server CPU Usage: 38.60%
> > Average Latency: 53.5 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 216: 49068
> > HUNDRED_USEC  :    0: 230094:   16:    3:    0:    1:    3:    1:
> > 0:    1
> > UNIT_MSEC     :    0:    0:    1:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      279404
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 4096,4096
> > Throughput: 542.06/542.06 Mbits/sec
> > Transactions Per Second: 8271.22
> > Client CPU Usage: 40.78%
> > Server CPU Usage: 37.96%
> > Average Latency: 60.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0: 248142:   27:    5:    0:    2:    0:    1:
> > 3:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      248180
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 8192,8192
> > Throughput: 797.34/797.34 Mbits/sec
> > Transactions Per Second: 6083.19
> > Client CPU Usage: 42.71%
> > Server CPU Usage: 41.68%
> > Average Latency: 82.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0: 182364:  146:   11:    2:    0:    0:    0:
> > 3:    2
> > UNIT_MSEC     :    0:    2:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      182530
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 16384,16384
> > Throughput: 1157.44/1157.44 Mbits/sec
> > Transactions Per Second: 4415.28
> > Client CPU Usage: 44.99%
> > Server CPU Usage: 43.21%
> > Average Latency: 113.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0: 132410:   51:   14:    0:    0:    1:
> > 0:    2
> > UNIT_MSEC     :    0:    4:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      132482
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 32768,32768
> > Throughput: 1452.17/1452.17 Mbits/sec
> > Transactions Per Second: 2769.80
> > Client CPU Usage: 46.36%
> > Server CPU Usage: 46.46%
> > Average Latency: 180.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0: 82724:  362:    9:    4:    1:
> > 0:    0
> > UNIT_MSEC     :    0:    8:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      83108
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 65536,65536
> > Throughput: 1673.55/1673.55 Mbits/sec
> > Transactions Per Second: 1596.02
> > Client CPU Usage: 49.18%
> > Server CPU Usage: 49.51%
> > Average Latency: 313.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:    0: 1643: 46044:  165:
> > 13:    4
> > UNIT_MSEC     :    0:   15:    1:    3:    0:    1:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      47889
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 131072,131072
> > Throughput: 1612.14/1612.14 Mbits/sec
> > Transactions Per Second: 768.73
> > Client CPU Usage: 47.64%
> > Server CPU Usage: 48.08%
> > Average Latency: 650.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0: 23061:    5:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      23066
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 262144,262144
> > Throughput: 1627.64/1627.64 Mbits/sec
> > Transactions Per Second: 388.06
> > Client CPU Usage: 47.19%
> > Server CPU Usage: 47.23%
> > Average Latency: 1288.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0: 11630:   14:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      11644
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 524288,524288
> > Throughput: 1615.65/1615.65 Mbits/sec
> > Transactions Per Second: 192.60
> > Client CPU Usage: 42.38%
> > Server CPU Usage: 41.98%
> > Average Latency: 2595.5 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0: 5773:    5:    1:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      5779
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 1048576,1048576
> > Throughput: 1585.11/1585.11 Mbits/sec
> > Transactions Per Second: 94.48
> > Client CPU Usage: 44.73%
> > Server CPU Usage: 45.28%
> > Average Latency: 5291.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0: 2835:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      2835
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 2097152,2097152
> > Throughput: 1573.37/1573.37 Mbits/sec
> > Transactions Per Second: 46.89
> > Client CPU Usage: 44.41%
> > Server CPU Usage: 44.44%
> > Average Latency: 10660.5 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0: 1407:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      1407
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_RR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 4194304,4194304
> > Throughput: 1570.35/1570.35 Mbits/sec
> > Transactions Per Second: 23.40
> > Client CPU Usage: 44.66%
> > Server CPU Usage: 44.94%
> > Average Latency: 21367.5 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:  701:    1:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      702
> > 
> > IP.Performance.Netperf.IPoIB2IPoIB.TCP_RR --> PASS
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 1 Bytes
> > Send/Receive Throughput: 0.8/0.8 Mbits/sec
> > Transactions Per Second: 100000.00/100000.00
> > Client CPU Usage: 70.17%
> > Server CPU Usage: 39.00%
> > Average Latency: 10.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    2:    1:    4:  397: 32444: 590880: 127843:
> > 17261: 102335: 476289
> > TEN_USEC      :    0: 1468054: 5039:  158:   38:   26:   29:    8:
> > 3:    5
> > HUNDRED_USEC  :    0:    3:    1:    0:    0:    1:    0:    0:
> > 0:    1
> > UNIT_MSEC     :    0:    1:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      2820823
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 2 Bytes
> > Send/Receive Throughput: 1.5/1.5 Mbits/sec
> > Transactions Per Second: 93750.00/93750.00
> > Client CPU Usage: 68.47%
> > Server CPU Usage: 39.26%
> > Average Latency: 10.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    2:    0:    7:  499: 49633: 663700: 113340:
> > 16018: 96336: 459767
> > TEN_USEC      :    0: 1453041: 5364:  161:   38:   32:   22:   11:
> > 3:    1
> > HUNDRED_USEC  :    0:    5:    0:    0:    0:    0:    0:    2:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      2857982
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 4 Bytes
> > Send/Receive Throughput: 3.0/3.0 Mbits/sec
> > Transactions Per Second: 93750.00/93750.00
> > Client CPU Usage: 72.74%
> > Server CPU Usage: 40.53%
> > Average Latency: 10.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    2:  351: 24587: 533947: 153488:
> > 28226: 97645: 446253
> > TEN_USEC      :    0: 1516044: 4598:  141:   34:   42:   36:   16:
> > 2:    1
> > HUNDRED_USEC  :    0:   18:    0:    0:    0:    0:    1:    2:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      2805434
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 8 Bytes
> > Send/Receive Throughput: 6.1/6.1 Mbits/sec
> > Transactions Per Second: 95312.50/95312.50
> > Client CPU Usage: 66.61%
> > Server CPU Usage: 39.66%
> > Average Latency: 10.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    1:    3:  497: 30938: 728412: 101538:
> > 11105: 76062: 383069
> > TEN_USEC      :    0: 1525813: 6627:  193:   35:   34:   35:    9:
> > 3:    1
> > HUNDRED_USEC  :    0:   17:    1:    0:    0:    0:    1:    2:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      2864396
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 16 Bytes
> > Send/Receive Throughput: 12.4/12.4 Mbits/sec
> > Transactions Per Second: 96875.00/96875.00
> > Client CPU Usage: 63.31%
> > Server CPU Usage: 39.75%
> > Average Latency: 10.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    1:  597: 21952: 829144: 123332:
> > 11243: 61878: 331263
> > TEN_USEC      :    0: 1517643: 7749:  199:   37:   44:   37:    7:
> > 3:    1
> > HUNDRED_USEC  :    0:   19:    1:    0:    0:    0:    1:    1:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      2905152
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 32 Bytes
> > Send/Receive Throughput: 24.5/24.5 Mbits/sec
> > Transactions Per Second: 95703.12/95703.12
> > Client CPU Usage: 64.59%
> > Server CPU Usage: 39.88%
> > Average Latency: 10.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    8:    0:    0:  518: 12974: 753506: 142912:
> > 12380: 66056: 335648
> > TEN_USEC      :    0: 1542888: 7424:  186:   46:   32:   22:    9:
> > 1:    3
> > HUNDRED_USEC  :    0:    5:    0:    0:    0:    1:    0:    0:
> > 1:    1
> > UNIT_MSEC     :    0:    1:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      2874622
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 64 Bytes
> > Send/Receive Throughput: 48.6/48.6 Mbits/sec
> > Transactions Per Second: 94921.88/94921.88
> > Client CPU Usage: 65.49%
> > Server CPU Usage: 40.20%
> > Average Latency: 10.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:  429: 5501: 684597: 155846: 12068:
> > 73608: 327969
> > TEN_USEC      :    0: 1581916: 7180:  189:   30:   35:   31:    4:
> > 1:    4
> > HUNDRED_USEC  :    0:    7:    0:    0:    0:    0:    0:    1:
> > 0:    2
> > UNIT_MSEC     :    0:    0:    1:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      2849419
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 128 Bytes
> > Send/Receive Throughput: 97.5/97.5 Mbits/sec
> > Transactions Per Second: 95214.84/95214.84
> > Client CPU Usage: 62.69%
> > Server CPU Usage: 40.53%
> > Average Latency: 10.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:  322: 1550: 614832: 270355: 11438:
> > 54148: 260719
> > TEN_USEC      :    0: 1633536: 9293:  217:   47:   49:   31:    6:
> > 5:    2
> > HUNDRED_USEC  :    0:   22:    1:    0:    0:    0:    1:    0:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      2856574
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 256 Bytes
> > Send/Receive Throughput: 184.8/184.8 Mbits/sec
> > Transactions Per Second: 90234.38/90234.38
> > Client CPU Usage: 68.45%
> > Server CPU Usage: 40.53%
> > Average Latency: 11.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:  123:  470: 281438: 335195: 14487:
> > 71901: 206608
> > TEN_USEC      :    0: 1788067: 8570:  203:   43:   31:   51:   11:
> > 4:    1
> > HUNDRED_USEC  :    0:   19:    1:    0:    0:    0:    1:    2:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      2707226
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 512 Bytes
> > Send/Receive Throughput: 345.4/345.4 Mbits/sec
> > Transactions Per Second: 84326.17/84326.17
> > Client CPU Usage: 71.67%
> > Server CPU Usage: 41.18%
> > Average Latency: 11.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:   34:  329: 53554: 388481: 27396:
> > 60007: 114619
> > TEN_USEC      :    0: 1876967: 8558:  173:   40:   31:   47:   16:
> > 3:    1
> > HUNDRED_USEC  :    0:   20:    0:    0:    0:    0:    1:    2:
> > 0:    0
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      2530279
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 1024 Bytes
> > Send/Receive Throughput: 641.9/641.8 Mbits/sec
> > Transactions Per Second: 78356.93/78344.73
> > Client CPU Usage: 70.04%
> > Server CPU Usage: 40.40%
> > Average Latency: 12.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:   78:  270: 160408: 285776:
> > 45574: 141023
> > TEN_USEC      :    0: 1702839: 14783:  227:   39:   30:   35:   14:
> > 3:    5
> > HUNDRED_USEC  :    0:    3:    2:    0:    0:    0:    0:    2:
> > 0:    2
> > UNIT_MSEC     :    0:    0:    0:    0:    1:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      2351114
> > 
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: UDP_STREAM
> > Test Duration: 30 seconds
> > Message Size: 1400 Bytes
> > Send/Receive Throughput: 845.7/845.3 Mbits/sec
> > Transactions Per Second: 75508.93/75473.21
> > Client CPU Usage: 68.94%
> > Server CPU Usage: 41.16%
> > Average Latency: 13.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    2:    0:    0:    0:   21:  233: 26835: 315643:
> > 26904: 93682
> > TEN_USEC      :    0: 1783838: 17988:  307:   41:   23:   39:    8:
> > 0:    1
> > HUNDRED_USEC  :    0:    9:    1:    0:    0:    0:    0:    0:
> > 2:    1
> > UNIT_MSEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      2265578
> > 
> > IP.Performance.Netperf.IPoIB2IPoIB.UDP_STREAM --> PASS
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_CC
> > Test Duration: 30 seconds
> > Transactions Per Second: 7125.44
> > Client CPU Usage: 36.28%
> > Server CPU Usage: 30.75%
> > Average Latency: 70.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > HUNDRED_USEC  :    0: 213764:   29:    4:    0:    0:    1:    0:
> > 0:    1
> > UNIT_MSEC     :    0:    1:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      213800
> > 
> > IP.Performance.Netperf.IPoIB2IPoIB.TCP_CC --> PASS
> > ###TEST-D: Netperf Test ipoib2ipoib from svbu-qa1850-2 to
> > svbu-qa1850-1
> > Test Type: TCP_CRR
> > Test Duration: 30 seconds
> > Send/Receive Message size: 1,1
> > Throughput: 0.09/0.09 Mbits/sec
> > Transactions Per Second: 5591.58
> > Client CPU Usage: 38.94%
> > Server CPU Usage: 34.20%
> > Average Latency: 89.0 usec
> > Histogram of latency distribution:
> > UNITS              0     1     2     3     4     5     6     7     8
> > 9
> > UNIT_USEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_USEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    1
> > HUNDRED_USEC  :    0: 167454:  307:    3:    2:    0:    0:    1:
> > 0:    2
> > UNIT_MSEC     :    0:    1:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TEN_MSEC      :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > TENTH_SEC     :    0:    0:    0:    0:    0:    0:    0:    0:
> > 0:    0
> > >1_SECS: 0
> > HIST_TOTAL:      167771
> > 
> > IP.Performance.Netperf.IPoIB2IPoIB.TCP_CRR --> PASS
> > ###TEST-S: Skipping ipoib2eth netperf test.  No EN hosts present.
> > IP.Performance.Netperf.IPoIB2Eth --> SKIP
> > ###TEST-S: Skipping Tests.  No EN GWs present.
> > Smoke.MGMT.ConfigL3Mode --> SKIP
> > ###TEST-S: Skipping eth2eth netperf test.  No EN hosts present.
> > IP.Performance.Netperf.Eth2Eth --> SKIP
> > ###TEST-S: Skipping Tests.  No EN GWs present.
> > Smoke.MGMT.ConfigL25Mode --> SKIP
> > ###TEST-S: Skipping eth2ipoib netperf test.  No EN hosts present.
> > IP.Performance.Netperf.Eth2IPoIB --> SKIP
> > Smoke.MGMT.MgmtIb --> PASS
> > 
> > End of protest run
> > 
> > 
> _______________________________________________
> openfabrics-ewg mailing list
> openfabrics-ewg at openib.org
> http://openib.org/mailman/listinfo/openfabrics-ewg
-------------- next part --------------
  sysctl -w net.ipv4.tcp_rmem="4096 87380 16777216"
  sysctl -w net.ipv4.tcp_wmem="4096 65536 16777216"
  sysctl net.core.rmem_default=87380
  sysctl net.core.rmem_max=16777216
  sysctl net.core.wmem_max=16777216
  sysctl net.core.wmem_default=87380


All benchmarks are with RHEL4 x86_64 with HCA FW v4.7.0
dual EM64T 3.2 GHz PCIe IB HCA (memfull)
patch 1 - remove changeset 314324121f9b94b2ca657a494cf2b9cb0e4a28cc
patch 2 - remove changeset b8259d9ad1d0f8d0c5ea0e37bb15080b0bd395b5
msi_x=1 for all tests

Kernel                OpenIB     netperf (MB/s)  
2.6.16-rc5           in-kernel    403      
tcp_wmem 4096 87380 16777216 tcp_rmem 4096 87380 16777216

2.6.16-rc5           in-kernel    395      
tcp_wmem 4096 102400 16777216 tcp_rmem 4096 102400 16777216

2.6.16-rc5           in-kernel    392      
tcp_wmem 4096 65536 16777216 tcp_rmem 4096 87380 16777216

2.6.16-rc5           in-kernel    394      
tcp_wmem 4096 131072 16777216 tcp_rmem 4096 102400 16777216

2.6.16-rc5           in-kernel    377      
tcp_wmem 4096 131072 16777216 tcp_rmem 4096 153600 16777216

2.6.16-rc5           in-kernel    377      
tcp_wmem 4096 131072 16777216 tcp_rmem 4096 131072 16777216

2.6.16-rc5           in-kernel    353      
tcp_wmem 4096 262144 16777216 tcp_rmem 4096 262144 16777216

2.6.16-rc5           in-kernel    305      
tcp_wmem 4096 262144 16777216 tcp_rmem 4096 524288 16777216

2.6.16-rc5           in-kernel    303      
tcp_wmem 4096 131072 16777216 tcp_rmem 4096 524288 16777216

2.6.16-rc5           in-kernel    290      
tcp_wmem 4096 524288 16777216 tcp_rmem 4096 524288 16777216

2.6.16-rc5           in-kernel    367      default tcp values

--------------------
netperf -f -M -c -C -H IP_ADDRESS

Kernel                OpenIB     netperf (MB/s)  
2.6.16               svn 6083     371 (mthca ipoib)
2.6.16               svn 6083     304 (ipath ipoib)
2.6.16               svn 5938     300 (ipath ipoib)
2.6.16               svn 5938     380 (mthca ipoib)
2.6.16               in-kernel    364
2.6.16-rc5           in-kernel    367      
2.6.15               in-kernel    382
2.6.14-rc4 patch 12  in-kernel    436 
2.6.14-rc4 patch 1   in-kernel    434 
2.6.14-rc4           in-kernel    385 
2.6.14-rc3           in-kernel    374 
2.6.13.2             svn3627      386 
2.6.13.2 patch 1     svn3627      446 
2.6.13.2             in-kernel    394 
2.6.13-rc3 patch 12  in-kernel    442 
2.6.13-rc3 patch 1   in-kernel    450 
2.6.13-rc3           in-kernel    395
2.6.13-rc2 patch 1   in-kernel    409
2.6.13-rc1 patch 1   in-kernel    408
2.6.12.5-lustre      in-kernel    399  
2.6.12.5 patch 1     in-kernel    464
2.6.12.5             in-kernel    402 
2.6.12               in-kernel    406 
2.6.12-rc6 patch 1   in-kernel    470 
2.6.12-rc6           in-kernel    407
2.6.12-rc5           in-kernel    405 
2.6.12-rc5 patch 1   in-kernel    474
2.6.12-rc4           in-kernel    470 
2.6.12-rc3           in-kernel    466 
2.6.12-rc2           in-kernel    469 
2.6.12-rc1           in-kernel    466
2.6.11               in-kernel    464 
2.6.11               svn3687      464 
2.6.9-11.ELsmp       svn3513      425  (Woody's results, 3.6Ghz EM64T) 


More information about the ewg mailing list