[openib-general] Re: [PATCH] rdma_lat-09 and results
Michael S. Tsirkin
mst at mellanox.co.il
Thu Jun 2 16:45:19 PDT 2005
Quoting r. Grant Grundler <iod00d at hp.com>:
> Subject: Re: [PATCH] rdma_lat-09 and results
>
> On Wed, Jun 01, 2005 at 05:52:28PM -0700, Grant Grundler wrote:
> > Here's with the new rdma_lat.c:
>
> Here are some pfmon31 perf results for the new rdma_lat.
> The first set is just L3 Cache misses.
> The second set shows all cache misses.
>
> The sample rate on the second set was a bit high - note the
> median cycle count was ~60 cycles higher than normal.
>
> Unfortunately pfmon doesn't look up symbols in shared libraries.
> Shared libraries live in 0x2... address space on ia64.
> I'll see if I can dig up the top hitters by hand.
> 0x20000000002d7021 in particular is "of interest".
>
> And PLEASE, if you reply, please delete quoted text you are not responding
> to from your reply. I'm getting tired of wading through 5 pages
> of quotes to get to a 3 line comment.
>
> grant
>
> ====================== FIRST SET - L3 CACHE MISSES ===============
>
> grundler at gsyprf3:/usr/src/openib_gen2/src/userspace/perftest$ taskset 1 ./rdma_lat -C -n 100000
> local address: LID 0x2d QPN 0x60406 PSN 0xd2cfc8 RKey 0x240434 VAddr 0x6000000000014001
> remote address: LID 0x2b QPN 0x60406 PSN 0x91ea3b RKey 0x240434 VAddr 0x6000000000014001
> Latency typical: 7140 cycles
> Latency best : 6881 cycles
> Latency worst : 293444 cycles
>
> grundler at iota:/usr/src/openib_gen2/src/userspace/perftest$ pfmon31 --us-c --cpu-list=1 --resolve-addr --smpl-module=dear-hist-itanium2 -e data_ear_cache_lat64 --long-smpl-periods=20 -- ./rdma_lat -C 10.0.0.51 -n 100000
> added event set 0
> local address: LID 0x2b QPN 0x60406 PSN 0x91ea3b RKey 0x240434 VAddr 0x6000000000014001
> remote address: LID 0x2d QPN 0x60406 PSN 0xd2cfc8 RKey 0x240434 VAddr 0x6000000000014001
> Latency typical: 7136.5 cycles
> Latency best : 6870 cycles
> Latency worst : 293396 cycles
> # total_samples 1937
> # instruction addr view
> # sorted by count
> # showing per per distinct value
> # %L2 : percentage of L1 misses that hit L2
> # %L3 : percentage of L1 misses that hit L3
> # %RAM : percentage of L1 misses that hit memory
> # L2 : 5 cycles load latency
> # L3 : 14 cycles load latency
> # sampling period: 20
> # #count %self %cum %L2 %L3 %RAM instruction addr
> 630 32.52% 32.52% 0.00% 0.00% 100.00% 0x200000000032ba80 0x200000000032ba80
> 612 31.60% 64.12% 0.00% 0.00% 100.00% 0x4000000000003f10 main+0x1a60<rdma_lat>
> 568 29.32% 93.44% 0.00% 0.00% 100.00% 0x4000000000003f60 main+0x1ab0<rdma_lat>
> 60 3.10% 96.54% 0.00% 0.00% 100.00% 0x4000000000003fd1 main+0x1b21<rdma_lat>
> 36 1.86% 98.40% 0.00% 0.00% 100.00% 0x40000000000040c0 main+0x1c10<rdma_lat>
> 10 0.52% 98.92% 0.00% 0.00% 100.00% 0x2000000000141081 0x2000000000141081
> 8 0.41% 99.33% 0.00% 0.00% 100.00% 0x40000000000040b0 main+0x1c00<rdma_lat>
> 8 0.41% 99.74% 0.00% 0.00% 100.00% 0x2000000000141061 0x2000000000141061
> 3 0.15% 99.90% 0.00% 0.00% 100.00% 0x20000000002d7021 0x20000000002d7021
> 1 0.05% 99.95% 0.00% 0.00% 100.00% 0x20000000001316f0 0x20000000001316f0
> 1 0.05% 100.00% 0.00% 0.00% 100.00% 0x4000000000002470 cycles_compare<rdma_lat>
> # level 0 : counts=0 avg_cycles=0.0ms 0.00%
> # level 1 : counts=0 avg_cycles=0.0ms 0.00%
> # level 2 : counts=1937 avg_cycles=0.0ms 100.00%
> approx cost: 0.0s
>
>
> ====================== SECOND SET - ALL CACHE LEVELS ===============
>
> grundler at gsyprf3:/usr/src/openib_gen2/src/userspace/perftest$ taskset 1 ./rdma_lat -C -n 100000
> local address: LID 0x2d QPN 0x80406 PSN 0xbb769a RKey 0x300434 VAddr 0x6000000000014001
> remote address: LID 0x2b QPN 0x80406 PSN 0x60ce3b RKey 0x300434 VAddr 0x6000000000014001
> Latency typical: 7203.5 cycles
> Latency best : 6881.5 cycles
> Latency worst : 297164 cycles
>
> grundler at iota:/usr/src/openib_gen2/src/userspace/perftest$ pfmon31 --us-c --cpu-list=1 --resolve-addr --smpl-module=dear-hist-itanium2 -e data_ear_cache_lat4 --long-smpl-periods=20 -- ./rdma_lat -C 10.0.0.51 -n 100000
> added event set 0
> local address: LID 0x2b QPN 0x80406 PSN 0x60ce3b RKey 0x300434 VAddr 0x6000000000014001
> remote address: LID 0x2d QPN 0x80406 PSN 0xbb769a RKey 0x300434 VAddr 0x6000000000014001
> Latency typical: 7196.5 cycles
> Latency best : 6896.5 cycles
> Latency worst : 297009 cycles
> # total_samples 231428
> # instruction addr view
> # sorted by count
> # showing per per distinct value
> # %L2 : percentage of L1 misses that hit L2
> # %L3 : percentage of L1 misses that hit L3
> # %RAM : percentage of L1 misses that hit memory
> # L2 : 5 cycles load latency
> # L3 : 14 cycles load latency
> # sampling period: 20
> # #count %self %cum %L2 %L3 %RAM instruction addr
> 55,598 24.02% 24.02% 99.94% 0.06% 0.00% 0x4000000000003f71 main+0x1ac1<rdma_lat>
> 55,461 23.96% 47.99% 0.00% 100.00% 0.00% 0x200000000032ba41 0x200000000032ba41
> 54,671 23.62% 71.61% 99.00% 0.09% 0.91% 0x4000000000003f60 main+0x1ab0<rdma_lat>
> 54,427 23.52% 95.13% 0.00% 0.00% 100.00% 0x20000000002d7021 0x20000000002d7021
> 1,327 0.57% 95.70% 74.91% 23.66% 1.43% 0x2000000000141061 0x2000000000141061
> 1,283 0.55% 96.26% 75.45% 21.75% 2.81% 0x2000000000141081 0x2000000000141081
> 808 0.35% 96.61% 93.56% 6.19% 0.25% 0x4000000000002470 cycles_compare<rdma_lat>
> 744 0.32% 96.93% 34.81% 0.00% 65.19% 0x200000000032ba80 0x200000000032ba80
> 710 0.31% 97.23% 0.00% 89.01% 10.99% 0x4000000000002471 cycles_compare+0x1<rdma_lat>
> 545 0.24% 97.47% 4.04% 10.09% 85.87% 0x4000000000003f10 main+0x1a60<rdma_lat>
> 522 0.23% 97.70% 100.00% 0.00% 0.00% 0x200000000032da70 0x200000000032da70
> 507 0.22% 97.92% 99.80% 0.20% 0.00% 0x40000000000048f0 main+0x2440<rdma_lat>
> 500 0.22% 98.13% 0.00% 0.00% 100.00% 0x4000000000003fd1 main+0x1b21<rdma_lat>
> 490 0.21% 98.34% 98.57% 1.43% 0.00% 0x200000000032d4c0 0x200000000032d4c0
> 485 0.21% 98.55% 0.00% 0.00% 100.00% 0x200000000032bac1 0x200000000032bac1
> 452 0.20% 98.75% 99.78% 0.22% 0.00% 0x200000000032bdb0 0x200000000032bdb0
> 448 0.19% 98.94% 99.78% 0.22% 0.00% 0x200000000032dd20 0x200000000032dd20
> 431 0.19% 99.13% 0.00% 100.00% 0.00% 0x200000000032b5d1 0x200000000032b5d1
> 418 0.18% 99.31% 77.51% 22.49% 0.00% 0x200000000032b8d0 0x200000000032b8d0
> 334 0.14% 99.45% 99.10% 0.90% 0.00% 0x4000000000004931 main+0x2481<rdma_lat>
> 258 0.11% 99.56% 98.45% 1.55% 0.00% 0x20000000001410d1 0x20000000001410d1
> 220 0.10% 99.66% 98.18% 1.82% 0.00% 0x20000000001410b0 0x20000000001410b0
> 91 0.04% 99.70% 42.86% 19.78% 37.36% 0x40000000000040c0 main+0x1c10<rdma_lat>
> 83 0.04% 99.73% 100.00% 0.00% 0.00% 0x200000000032bcd1 0x200000000032bcd1
> 74 0.03% 99.77% 1.35% 98.65% 0.00% 0x4000000000003f90 main+0x1ae0<rdma_lat>
> 55 0.02% 99.79% 100.00% 0.00% 0.00% 0x2000000000141100 0x2000000000141100
> 44 0.02% 99.81% 20.45% 79.55% 0.00% 0x20000000000ae0b0 0x20000000000ae0b0
> 37 0.02% 99.82% 24.32% 70.27% 5.41% 0x20000000000ae0e0 0x20000000000ae0e0
> 25 0.01% 99.84% 4.00% 0.00% 96.00% 0x40000000000040b0 main+0x1c00<rdma_lat>
> 21 0.01% 99.84% 0.00% 100.00% 0.00% 0x200000000032b9d1 0x200000000032b9d1
> 21 0.01% 99.85% 14.29% 85.71% 0.00% 0x4000000000004950 main+0x24a0<rdma_lat>
> 20 0.01% 99.86% 100.00% 0.00% 0.00% 0x200000000032d571 0x200000000032d571
> 15 0.01% 99.87% 33.33% 53.33% 13.33% 0x20000000000231d0 0x20000000000231d0
> 14 0.01% 99.88% 100.00% 0.00% 0.00% 0x200000000032fb40 0x200000000032fb40
> 11 0.00% 99.88% 0.00% 100.00% 0.00% 0x2000000000141111 0x2000000000141111
> 10 0.00% 99.88% 70.00% 20.00% 10.00% 0x2000000000011020 0x2000000000011020
> 8 0.00% 99.89% 75.00% 25.00% 0.00% 0x2000000000010f90 0x2000000000010f90
> 8 0.00% 99.89% 62.50% 37.50% 0.00% 0x200000000032d500 0x200000000032d500
> 6 0.00% 99.89% 66.67% 16.67% 16.67% 0x2000000000011060 0x2000000000011060
> 5 0.00% 99.90% 0.00% 100.00% 0.00% 0x2000000000021570 0x2000000000021570
> 5 0.00% 99.90% 20.00% 60.00% 20.00% 0x2000000000014b21 0x2000000000014b21
> 5 0.00% 99.90% 100.00% 0.00% 0.00% 0x2000000000021880 0x2000000000021880
> 5 0.00% 99.90% 20.00% 80.00% 0.00% 0x2000000000010fd1 0x2000000000010fd1
> 5 0.00% 99.90% 100.00% 0.00% 0.00% 0x2000000000010ad0 0x2000000000010ad0
> 5 0.00% 99.91% 100.00% 0.00% 0.00% 0x200000000032b8f1 0x200000000032b8f1
> 4 0.00% 99.91% 0.00% 25.00% 75.00% 0x2000000000018c20 0x2000000000018c20
> 4 0.00% 99.91% 100.00% 0.00% 0.00% 0x2000000000021520 0x2000000000021520
> 4 0.00% 99.91% 25.00% 75.00% 0.00% 0x2000000000010a81 0x2000000000010a81
> 4 0.00% 99.91% 0.00% 100.00% 0.00% 0x4000000000004941 main+0x2491<rdma_lat>
> 3 0.00% 99.91% 66.67% 33.33% 0.00% 0x2000000000014b11 0x2000000000014b11
> 3 0.00% 99.92% 33.33% 33.33% 33.33% 0x2000000000017de0 0x2000000000017de0
> 3 0.00% 99.92% 66.67% 33.33% 0.00% 0x2000000000018421 0x2000000000018421
> 3 0.00% 99.92% 66.67% 33.33% 0.00% 0x200000000012f791 0x200000000012f791
> 3 0.00% 99.92% 0.00% 33.33% 66.67% 0x200000000012f850 0x200000000012f850
> 3 0.00% 99.92% 0.00% 100.00% 0.00% 0x2000000000010a41 0x2000000000010a41
> 3 0.00% 99.92% 66.67% 33.33% 0.00% 0x20000000000110c0 0x20000000000110c0
> 3 0.00% 99.92% 0.00% 0.00% 100.00% 0x20000000001dfa00 0x20000000001dfa00
> 3 0.00% 99.93% 100.00% 0.00% 0.00% 0x200000000032d740 0x200000000032d740
> 3 0.00% 99.93% 0.00% 100.00% 0.00% 0x200000000032fad0 0x200000000032fad0
> 2 0.00% 99.93% 0.00% 0.00% 100.00% 0x20000000000231d1 0x20000000000231d1
> 2 0.00% 99.93% 50.00% 50.00% 0.00% 0x2000000000010770 0x2000000000010770
> 2 0.00% 99.93% 0.00% 100.00% 0.00% 0x2000000000015020 0x2000000000015020
> 2 0.00% 99.93% 50.00% 50.00% 0.00% 0x2000000000014610 0x2000000000014610
> 2 0.00% 99.93% 0.00% 100.00% 0.00% 0x2000000000021850 0x2000000000021850
> 2 0.00% 99.93% 100.00% 0.00% 0.00% 0x2000000000014a20 0x2000000000014a20
> 2 0.00% 99.93% 100.00% 0.00% 0.00% 0x2000000000011090 0x2000000000011090
> 2 0.00% 99.93% 100.00% 0.00% 0.00% 0x2000000000014ba0 0x2000000000014ba0
> 2 0.00% 99.93% 0.00% 50.00% 50.00% 0x2000000000010f10 0x2000000000010f10
> 2 0.00% 99.94% 50.00% 50.00% 0.00% 0x2000000000018451 0x2000000000018451
> 2 0.00% 99.94% 0.00% 0.00% 100.00% 0x2000000000010f20 0x2000000000010f20
> 2 0.00% 99.94% 0.00% 100.00% 0.00% 0x20000000000126d0 0x20000000000126d0
> 2 0.00% 99.94% 100.00% 0.00% 0.00% 0x200000000012f781 0x200000000012f781
> 2 0.00% 99.94% 0.00% 100.00% 0.00% 0x20000000001906f1 0x20000000001906f1
> 2 0.00% 99.94% 100.00% 0.00% 0.00% 0x20000000000109e0 0x20000000000109e0
> 2 0.00% 99.94% 0.00% 0.00% 100.00% 0x20000000001deba0 0x20000000001deba0
> 2 0.00% 99.94% 50.00% 0.00% 50.00% 0x20000000002a4481 0x20000000002a4481
> 2 0.00% 99.94% 0.00% 100.00% 0.00% 0x2000000000190780 0x2000000000190780
> 2 0.00% 99.94% 0.00% 50.00% 50.00% 0x2000000000017d41 0x2000000000017d41
> 2 0.00% 99.94% 0.00% 100.00% 0.00% 0x20000000002b1ff1 0x20000000002b1ff1
> 2 0.00% 99.94% 100.00% 0.00% 0.00% 0x200000000013c7d1 0x200000000013c7d1
> 2 0.00% 99.95% 50.00% 50.00% 0.00% 0x200000000032d640 0x200000000032d640
> 2 0.00% 99.95% 0.00% 100.00% 0.00% 0x200000000032bc61 0x200000000032bc61
> 2 0.00% 99.95% 50.00% 50.00% 0.00% 0x200000000032a030 0x200000000032a030
> 2 0.00% 99.95% 100.00% 0.00% 0.00% 0x200000000032a450 0x200000000032a450
> 2 0.00% 99.95% 100.00% 0.00% 0.00% 0x200000000032fb70 0x200000000032fb70
> 2 0.00% 99.95% 100.00% 0.00% 0.00% 0x200000000032fac1 0x200000000032fac1
> 2 0.00% 99.95% 50.00% 50.00% 0.00% 0x2000000000083b30 0x2000000000083b30
> 1 0.00% 99.95% 100.00% 0.00% 0.00% 0x2000000000005330 0x2000000000005330
> 1 0.00% 99.95% 0.00% 100.00% 0.00% 0x200000000000c3d0 0x200000000000c3d0
> 1 0.00% 99.95% 100.00% 0.00% 0.00% 0x200000000000c530 0x200000000000c530
> 1 0.00% 99.95% 100.00% 0.00% 0.00% 0x20000000000165b0 0x20000000000165b0
> 1 0.00% 99.95% 0.00% 100.00% 0.00% 0x20000000000246d1 0x20000000000246d1
> 1 0.00% 99.95% 100.00% 0.00% 0.00% 0x20000000000059f0 0x20000000000059f0
> 1 0.00% 99.95% 0.00% 100.00% 0.00% 0x20000000000062e0 0x20000000000062e0
> 1 0.00% 99.95% 100.00% 0.00% 0.00% 0x20000000000216f0 0x20000000000216f0
> 1 0.00% 99.95% 100.00% 0.00% 0.00% 0x2000000000010e30 0x2000000000010e30
> 1 0.00% 99.96% 0.00% 100.00% 0.00% 0x2000000000014d81 0x2000000000014d81
> 1 0.00% 99.96% 0.00% 100.00% 0.00% 0x2000000000021800 0x2000000000021800
> 1 0.00% 99.96% 0.00% 100.00% 0.00% 0x2000000000006400 0x2000000000006400
> 1 0.00% 99.96% 100.00% 0.00% 0.00% 0x2000000000011f40 0x2000000000011f40
> 1 0.00% 99.96% 0.00% 100.00% 0.00% 0x2000000000014d71 0x2000000000014d71
> 1 0.00% 99.96% 100.00% 0.00% 0.00% 0x2000000000018441 0x2000000000018441
> 1 0.00% 99.96% 0.00% 0.00% 100.00% 0x2000000000019070 0x2000000000019070
> 1 0.00% 99.96% 100.00% 0.00% 0.00% 0x20000000001356e1 0x20000000001356e1
> 1 0.00% 99.96% 100.00% 0.00% 0.00% 0x20000000000107c1 0x20000000000107c1
> 1 0.00% 99.96% 100.00% 0.00% 0.00% 0x2000000000010a10 0x2000000000010a10
> 1 0.00% 99.96% 0.00% 100.00% 0.00% 0x2000000000010e00 0x2000000000010e00
> 1 0.00% 99.96% 0.00% 100.00% 0.00% 0x2000000000010a11 0x2000000000010a11
> 1 0.00% 99.96% 0.00% 100.00% 0.00% 0x2000000000018ce1 0x2000000000018ce1
> 1 0.00% 99.96% 0.00% 100.00% 0.00% 0x2000000000010f21 0x2000000000010f21
> 1 0.00% 99.96% 0.00% 100.00% 0.00% 0x2000000000018c30 0x2000000000018c30
> 1 0.00% 99.96% 100.00% 0.00% 0.00% 0x200000000000e6b0 0x200000000000e6b0
> 1 0.00% 99.96% 0.00% 100.00% 0.00% 0x20000000000171d1 0x20000000000171d1
> 1 0.00% 99.96% 100.00% 0.00% 0.00% 0x2000000000010f50 0x2000000000010f50
> 1 0.00% 99.96% 0.00% 0.00% 100.00% 0x2000000000044741 0x2000000000044741
> 1 0.00% 99.96% 0.00% 0.00% 100.00% 0x20000000002d83a1 0x20000000002d83a1
> 1 0.00% 99.96% 0.00% 100.00% 0.00% 0x20000000002a4d10 0x20000000002a4d10
> 1 0.00% 99.96% 0.00% 100.00% 0.00% 0x20000000000841e1 0x20000000000841e1
> 1 0.00% 99.96% 100.00% 0.00% 0.00% 0x20000000002a4e00 0x20000000002a4e00
> 1 0.00% 99.96% 0.00% 100.00% 0.00% 0x2000000000017e81 0x2000000000017e81
> 1 0.00% 99.97% 0.00% 0.00% 100.00% 0x20000000002a3f81 0x20000000002a3f81
> 1 0.00% 99.97% 0.00% 0.00% 100.00% 0x2000000000017d20 0x2000000000017d20
> 1 0.00% 99.97% 0.00% 100.00% 0.00% 0x20000000000109f0 0x20000000000109f0
> 1 0.00% 99.97% 0.00% 100.00% 0.00% 0x20000000002a6ca0 0x20000000002a6ca0
> 1 0.00% 99.97% 100.00% 0.00% 0.00% 0x2000000000017f70 0x2000000000017f70
> 1 0.00% 99.97% 100.00% 0.00% 0.00% 0x20000000002a7b11 0x20000000002a7b11
> 1 0.00% 99.97% 0.00% 100.00% 0.00% 0x2000000000017d21 0x2000000000017d21
> 1 0.00% 99.97% 100.00% 0.00% 0.00% 0x20000000002acb90 0x20000000002acb90
> 1 0.00% 99.97% 100.00% 0.00% 0.00% 0x20000000002a6770 0x20000000002a6770
> 1 0.00% 99.97% 100.00% 0.00% 0.00% 0x2000000000132290 0x2000000000132290
> 1 0.00% 99.97% 0.00% 100.00% 0.00% 0x20000000002a4cd0 0x20000000002a4cd0
> 1 0.00% 99.97% 0.00% 100.00% 0.00% 0x20000000002a43a1 0x20000000002a43a1
> 1 0.00% 99.97% 0.00% 100.00% 0.00% 0x20000000000109e1 0x20000000000109e1
> 1 0.00% 99.97% 100.00% 0.00% 0.00% 0x20000000002a4321 0x20000000002a4321
> 1 0.00% 99.97% 100.00% 0.00% 0.00% 0x2000000000084190 0x2000000000084190
> 1 0.00% 99.97% 100.00% 0.00% 0.00% 0x2000000000011b41 0x2000000000011b41
> 1 0.00% 99.97% 0.00% 100.00% 0.00% 0x200000000010e4d1 0x200000000010e4d1
> 1 0.00% 99.97% 100.00% 0.00% 0.00% 0x20000000002a4461 0x20000000002a4461
> 1 0.00% 99.97% 100.00% 0.00% 0.00% 0x200000000013a1f0 0x200000000013a1f0
> 1 0.00% 99.97% 100.00% 0.00% 0.00% 0x20000000002a4201 0x20000000002a4201
> 1 0.00% 99.97% 100.00% 0.00% 0.00% 0x20000000002b27a0 0x20000000002b27a0
> 1 0.00% 99.97% 0.00% 100.00% 0.00% 0x20000000002a3da1 0x20000000002a3da1
> 1 0.00% 99.97% 100.00% 0.00% 0.00% 0x20000000002a4301 0x20000000002a4301
> 1 0.00% 99.98% 0.00% 100.00% 0.00% 0x2000000000132860 0x2000000000132860
> 1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000002a4021 0x20000000002a4021
> 1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000002b1ff0 0x20000000002b1ff0
> 1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000002a4741 0x20000000002a4741
> 1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000002a3f01 0x20000000002a3f01
> 1 0.00% 99.98% 100.00% 0.00% 0.00% 0x200000000013cb70 0x200000000013cb70
> 1 0.00% 99.98% 0.00% 0.00% 100.00% 0x20000000001906b0 0x20000000001906b0
> 1 0.00% 99.98% 0.00% 0.00% 100.00% 0x200000000012f7b1 0x200000000012f7b1
> 1 0.00% 99.98% 0.00% 100.00% 0.00% 0x20000000001321c1 0x20000000001321c1
> 1 0.00% 99.98% 0.00% 100.00% 0.00% 0x20000000001314a0 0x20000000001314a0
> 1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000002a4210 0x20000000002a4210
> 1 0.00% 99.98% 100.00% 0.00% 0.00% 0x2000000000132240 0x2000000000132240
> 1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000002a4430 0x20000000002a4430
> 1 0.00% 99.98% 100.00% 0.00% 0.00% 0x200000000013ce11 0x200000000013ce11
> 1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000001308d1 0x20000000001308d1
> 1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000001d0ea1 0x20000000001d0ea1
> 1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000002b1b70 0x20000000002b1b70
> 1 0.00% 99.98% 100.00% 0.00% 0.00% 0x2000000000131a20 0x2000000000131a20
> 1 0.00% 99.98% 0.00% 100.00% 0.00% 0x20000000001318b0 0x20000000001318b0
> 1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000002b1e00 0x20000000002b1e00
> 1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000002a4810 0x20000000002a4810
> 1 0.00% 99.98% 100.00% 0.00% 0.00% 0x2000000000017e60 0x2000000000017e60
> 1 0.00% 99.98% 0.00% 100.00% 0.00% 0x4000000000002600 main+0x150<rdma_lat>
> 1 0.00% 99.99% 0.00% 100.00% 0.00% 0x20000000001317b1 0x20000000001317b1
> 1 0.00% 99.99% 0.00% 100.00% 0.00% 0x2000000000010df0 0x2000000000010df0
> 1 0.00% 99.99% 0.00% 100.00% 0.00% 0x2000000000045c80 0x2000000000045c80
> 1 0.00% 99.99% 0.00% 0.00% 100.00% 0x200000000012f701 0x200000000012f701
> 1 0.00% 99.99% 0.00% 100.00% 0.00% 0x4000000000001290 _init+0x50<rdma_lat>
> 1 0.00% 99.99% 0.00% 0.00% 100.00% 0x20000000000e0560 0x20000000000e0560
> 1 0.00% 99.99% 100.00% 0.00% 0.00% 0x2000000000017e20 0x2000000000017e20
> 1 0.00% 99.99% 0.00% 100.00% 0.00% 0x4000000000003650 main+0x11a0<rdma_lat>
> 1 0.00% 99.99% 100.00% 0.00% 0.00% 0x20000000000e51f1 0x20000000000e51f1
> 1 0.00% 99.99% 0.00% 100.00% 0.00% 0x2000000000017d00 0x2000000000017d00
> 1 0.00% 99.99% 0.00% 100.00% 0.00% 0x20000000000b3660 0x20000000000b3660
> 1 0.00% 99.99% 0.00% 0.00% 100.00% 0x20000000000424e1 0x20000000000424e1
> 1 0.00% 99.99% 0.00% 0.00% 100.00% 0x200000000012d051 0x200000000012d051
> 1 0.00% 99.99% 0.00% 100.00% 0.00% 0x200000000032ba40 0x200000000032ba40
> 1 0.00% 99.99% 0.00% 100.00% 0.00% 0x200000000032be50 0x200000000032be50
> 1 0.00% 99.99% 100.00% 0.00% 0.00% 0x200000000032d8b0 0x200000000032d8b0
> 1 0.00% 99.99% 100.00% 0.00% 0.00% 0x200000000032a201 0x200000000032a201
> 1 0.00% 99.99% 100.00% 0.00% 0.00% 0x200000000032be10 0x200000000032be10
> 1 0.00% 99.99% 0.00% 100.00% 0.00% 0x4000000000003f81 main+0x1ad1<rdma_lat>
> 1 0.00% 99.99% 0.00% 100.00% 0.00% 0x200000000032ba50 0x200000000032ba50
> 1 0.00% 99.99% 0.00% 100.00% 0.00% 0x200000000032bc01 0x200000000032bc01
> 1 0.00% 99.99% 0.00% 100.00% 0.00% 0x4000000000003f91 main+0x1ae1<rdma_lat>
> 1 0.00% 99.99% 0.00% 100.00% 0.00% 0x200000000032bc60 0x200000000032bc60
> 1 0.00% 100.00% 100.00% 0.00% 0.00% 0x200000000032b570 0x200000000032b570
> 1 0.00% 100.00% 100.00% 0.00% 0.00% 0x200000000032a441 0x200000000032a441
> 1 0.00% 100.00% 100.00% 0.00% 0.00% 0x200000000032a210 0x200000000032a210
> 1 0.00% 100.00% 100.00% 0.00% 0.00% 0x200000000013f311 0x200000000013f311
> 1 0.00% 100.00% 100.00% 0.00% 0.00% 0x200000000012faf0 0x200000000012faf0
> 1 0.00% 100.00% 0.00% 100.00% 0.00% 0x200000000012c181 0x200000000012c181
> 1 0.00% 100.00% 100.00% 0.00% 0.00% 0x20000000000ae341 0x20000000000ae341
> 1 0.00% 100.00% 100.00% 0.00% 0.00% 0x20000000000ae340 0x20000000000ae340
> 1 0.00% 100.00% 100.00% 0.00% 0.00% 0x20000000000db490 0x20000000000db490
> 1 0.00% 100.00% 0.00% 100.00% 0.00% 0x20000000000ef5d0 0x20000000000ef5d0
> 1 0.00% 100.00% 0.00% 0.00% 100.00% 0x2000000000019620 0x2000000000019620
> 1 0.00% 100.00% 100.00% 0.00% 0.00% 0x20000000000198d1 0x20000000000198d1
> # level 0 : counts=116599 avg_cycles=0.0ms 50.38%
> # level 1 : counts=57736 avg_cycles=0.0ms 24.95%
> # level 2 : counts=57093 avg_cycles=0.0ms 24.67%
> approx cost: 0.0s
>
> _______________________________________________
> openib-general mailing list
> openib-general at openib.org
> http://openib.org/mailman/listinfo/openib-general
>
> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
>
Its possible to link libibverbs and libmthca statically.
I did it once.
--
MST
More information about the general
mailing list