[openib-general] [PATCH] rdma_lat-09 and results
Grant Grundler
iod00d at hp.com
Thu Jun 2 10:07:34 PDT 2005
On Wed, Jun 01, 2005 at 05:52:28PM -0700, Grant Grundler wrote:
> Here's with the new rdma_lat.c:
Here are some pfmon31 perf results for the new rdma_lat.
The first set is just L3 Cache misses.
The second set shows all cache misses.
The sample rate on the second set was a bit high - note the
median cycle count was ~60 cycles higher than normal.
Unfortunately pfmon doesn't look up symbols in shared libraries.
Shared libraries live in 0x2... address space on ia64.
I'll see if I can dig up the top hitters by hand.
0x20000000002d7021 in particular is "of interest".
And PLEASE, if you reply, please delete quoted text you are not responding
to from your reply. I'm getting tired of wading through 5 pages
of quotes to get to a 3 line comment.
grant
====================== FIRST SET - L3 CACHE MISSES ===============
grundler at gsyprf3:/usr/src/openib_gen2/src/userspace/perftest$ taskset 1 ./rdma_lat -C -n 100000
local address: LID 0x2d QPN 0x60406 PSN 0xd2cfc8 RKey 0x240434 VAddr 0x6000000000014001
remote address: LID 0x2b QPN 0x60406 PSN 0x91ea3b RKey 0x240434 VAddr 0x6000000000014001
Latency typical: 7140 cycles
Latency best : 6881 cycles
Latency worst : 293444 cycles
grundler at iota:/usr/src/openib_gen2/src/userspace/perftest$ pfmon31 --us-c --cpu-list=1 --resolve-addr --smpl-module=dear-hist-itanium2 -e data_ear_cache_lat64 --long-smpl-periods=20 -- ./rdma_lat -C 10.0.0.51 -n 100000
added event set 0
local address: LID 0x2b QPN 0x60406 PSN 0x91ea3b RKey 0x240434 VAddr 0x6000000000014001
remote address: LID 0x2d QPN 0x60406 PSN 0xd2cfc8 RKey 0x240434 VAddr 0x6000000000014001
Latency typical: 7136.5 cycles
Latency best : 6870 cycles
Latency worst : 293396 cycles
# total_samples 1937
# instruction addr view
# sorted by count
# showing per per distinct value
# %L2 : percentage of L1 misses that hit L2
# %L3 : percentage of L1 misses that hit L3
# %RAM : percentage of L1 misses that hit memory
# L2 : 5 cycles load latency
# L3 : 14 cycles load latency
# sampling period: 20
# #count %self %cum %L2 %L3 %RAM instruction addr
630 32.52% 32.52% 0.00% 0.00% 100.00% 0x200000000032ba80 0x200000000032ba80
612 31.60% 64.12% 0.00% 0.00% 100.00% 0x4000000000003f10 main+0x1a60<rdma_lat>
568 29.32% 93.44% 0.00% 0.00% 100.00% 0x4000000000003f60 main+0x1ab0<rdma_lat>
60 3.10% 96.54% 0.00% 0.00% 100.00% 0x4000000000003fd1 main+0x1b21<rdma_lat>
36 1.86% 98.40% 0.00% 0.00% 100.00% 0x40000000000040c0 main+0x1c10<rdma_lat>
10 0.52% 98.92% 0.00% 0.00% 100.00% 0x2000000000141081 0x2000000000141081
8 0.41% 99.33% 0.00% 0.00% 100.00% 0x40000000000040b0 main+0x1c00<rdma_lat>
8 0.41% 99.74% 0.00% 0.00% 100.00% 0x2000000000141061 0x2000000000141061
3 0.15% 99.90% 0.00% 0.00% 100.00% 0x20000000002d7021 0x20000000002d7021
1 0.05% 99.95% 0.00% 0.00% 100.00% 0x20000000001316f0 0x20000000001316f0
1 0.05% 100.00% 0.00% 0.00% 100.00% 0x4000000000002470 cycles_compare<rdma_lat>
# level 0 : counts=0 avg_cycles=0.0ms 0.00%
# level 1 : counts=0 avg_cycles=0.0ms 0.00%
# level 2 : counts=1937 avg_cycles=0.0ms 100.00%
approx cost: 0.0s
====================== SECOND SET - ALL CACHE LEVELS ===============
grundler at gsyprf3:/usr/src/openib_gen2/src/userspace/perftest$ taskset 1 ./rdma_lat -C -n 100000
local address: LID 0x2d QPN 0x80406 PSN 0xbb769a RKey 0x300434 VAddr 0x6000000000014001
remote address: LID 0x2b QPN 0x80406 PSN 0x60ce3b RKey 0x300434 VAddr 0x6000000000014001
Latency typical: 7203.5 cycles
Latency best : 6881.5 cycles
Latency worst : 297164 cycles
grundler at iota:/usr/src/openib_gen2/src/userspace/perftest$ pfmon31 --us-c --cpu-list=1 --resolve-addr --smpl-module=dear-hist-itanium2 -e data_ear_cache_lat4 --long-smpl-periods=20 -- ./rdma_lat -C 10.0.0.51 -n 100000
added event set 0
local address: LID 0x2b QPN 0x80406 PSN 0x60ce3b RKey 0x300434 VAddr 0x6000000000014001
remote address: LID 0x2d QPN 0x80406 PSN 0xbb769a RKey 0x300434 VAddr 0x6000000000014001
Latency typical: 7196.5 cycles
Latency best : 6896.5 cycles
Latency worst : 297009 cycles
# total_samples 231428
# instruction addr view
# sorted by count
# showing per per distinct value
# %L2 : percentage of L1 misses that hit L2
# %L3 : percentage of L1 misses that hit L3
# %RAM : percentage of L1 misses that hit memory
# L2 : 5 cycles load latency
# L3 : 14 cycles load latency
# sampling period: 20
# #count %self %cum %L2 %L3 %RAM instruction addr
55,598 24.02% 24.02% 99.94% 0.06% 0.00% 0x4000000000003f71 main+0x1ac1<rdma_lat>
55,461 23.96% 47.99% 0.00% 100.00% 0.00% 0x200000000032ba41 0x200000000032ba41
54,671 23.62% 71.61% 99.00% 0.09% 0.91% 0x4000000000003f60 main+0x1ab0<rdma_lat>
54,427 23.52% 95.13% 0.00% 0.00% 100.00% 0x20000000002d7021 0x20000000002d7021
1,327 0.57% 95.70% 74.91% 23.66% 1.43% 0x2000000000141061 0x2000000000141061
1,283 0.55% 96.26% 75.45% 21.75% 2.81% 0x2000000000141081 0x2000000000141081
808 0.35% 96.61% 93.56% 6.19% 0.25% 0x4000000000002470 cycles_compare<rdma_lat>
744 0.32% 96.93% 34.81% 0.00% 65.19% 0x200000000032ba80 0x200000000032ba80
710 0.31% 97.23% 0.00% 89.01% 10.99% 0x4000000000002471 cycles_compare+0x1<rdma_lat>
545 0.24% 97.47% 4.04% 10.09% 85.87% 0x4000000000003f10 main+0x1a60<rdma_lat>
522 0.23% 97.70% 100.00% 0.00% 0.00% 0x200000000032da70 0x200000000032da70
507 0.22% 97.92% 99.80% 0.20% 0.00% 0x40000000000048f0 main+0x2440<rdma_lat>
500 0.22% 98.13% 0.00% 0.00% 100.00% 0x4000000000003fd1 main+0x1b21<rdma_lat>
490 0.21% 98.34% 98.57% 1.43% 0.00% 0x200000000032d4c0 0x200000000032d4c0
485 0.21% 98.55% 0.00% 0.00% 100.00% 0x200000000032bac1 0x200000000032bac1
452 0.20% 98.75% 99.78% 0.22% 0.00% 0x200000000032bdb0 0x200000000032bdb0
448 0.19% 98.94% 99.78% 0.22% 0.00% 0x200000000032dd20 0x200000000032dd20
431 0.19% 99.13% 0.00% 100.00% 0.00% 0x200000000032b5d1 0x200000000032b5d1
418 0.18% 99.31% 77.51% 22.49% 0.00% 0x200000000032b8d0 0x200000000032b8d0
334 0.14% 99.45% 99.10% 0.90% 0.00% 0x4000000000004931 main+0x2481<rdma_lat>
258 0.11% 99.56% 98.45% 1.55% 0.00% 0x20000000001410d1 0x20000000001410d1
220 0.10% 99.66% 98.18% 1.82% 0.00% 0x20000000001410b0 0x20000000001410b0
91 0.04% 99.70% 42.86% 19.78% 37.36% 0x40000000000040c0 main+0x1c10<rdma_lat>
83 0.04% 99.73% 100.00% 0.00% 0.00% 0x200000000032bcd1 0x200000000032bcd1
74 0.03% 99.77% 1.35% 98.65% 0.00% 0x4000000000003f90 main+0x1ae0<rdma_lat>
55 0.02% 99.79% 100.00% 0.00% 0.00% 0x2000000000141100 0x2000000000141100
44 0.02% 99.81% 20.45% 79.55% 0.00% 0x20000000000ae0b0 0x20000000000ae0b0
37 0.02% 99.82% 24.32% 70.27% 5.41% 0x20000000000ae0e0 0x20000000000ae0e0
25 0.01% 99.84% 4.00% 0.00% 96.00% 0x40000000000040b0 main+0x1c00<rdma_lat>
21 0.01% 99.84% 0.00% 100.00% 0.00% 0x200000000032b9d1 0x200000000032b9d1
21 0.01% 99.85% 14.29% 85.71% 0.00% 0x4000000000004950 main+0x24a0<rdma_lat>
20 0.01% 99.86% 100.00% 0.00% 0.00% 0x200000000032d571 0x200000000032d571
15 0.01% 99.87% 33.33% 53.33% 13.33% 0x20000000000231d0 0x20000000000231d0
14 0.01% 99.88% 100.00% 0.00% 0.00% 0x200000000032fb40 0x200000000032fb40
11 0.00% 99.88% 0.00% 100.00% 0.00% 0x2000000000141111 0x2000000000141111
10 0.00% 99.88% 70.00% 20.00% 10.00% 0x2000000000011020 0x2000000000011020
8 0.00% 99.89% 75.00% 25.00% 0.00% 0x2000000000010f90 0x2000000000010f90
8 0.00% 99.89% 62.50% 37.50% 0.00% 0x200000000032d500 0x200000000032d500
6 0.00% 99.89% 66.67% 16.67% 16.67% 0x2000000000011060 0x2000000000011060
5 0.00% 99.90% 0.00% 100.00% 0.00% 0x2000000000021570 0x2000000000021570
5 0.00% 99.90% 20.00% 60.00% 20.00% 0x2000000000014b21 0x2000000000014b21
5 0.00% 99.90% 100.00% 0.00% 0.00% 0x2000000000021880 0x2000000000021880
5 0.00% 99.90% 20.00% 80.00% 0.00% 0x2000000000010fd1 0x2000000000010fd1
5 0.00% 99.90% 100.00% 0.00% 0.00% 0x2000000000010ad0 0x2000000000010ad0
5 0.00% 99.91% 100.00% 0.00% 0.00% 0x200000000032b8f1 0x200000000032b8f1
4 0.00% 99.91% 0.00% 25.00% 75.00% 0x2000000000018c20 0x2000000000018c20
4 0.00% 99.91% 100.00% 0.00% 0.00% 0x2000000000021520 0x2000000000021520
4 0.00% 99.91% 25.00% 75.00% 0.00% 0x2000000000010a81 0x2000000000010a81
4 0.00% 99.91% 0.00% 100.00% 0.00% 0x4000000000004941 main+0x2491<rdma_lat>
3 0.00% 99.91% 66.67% 33.33% 0.00% 0x2000000000014b11 0x2000000000014b11
3 0.00% 99.92% 33.33% 33.33% 33.33% 0x2000000000017de0 0x2000000000017de0
3 0.00% 99.92% 66.67% 33.33% 0.00% 0x2000000000018421 0x2000000000018421
3 0.00% 99.92% 66.67% 33.33% 0.00% 0x200000000012f791 0x200000000012f791
3 0.00% 99.92% 0.00% 33.33% 66.67% 0x200000000012f850 0x200000000012f850
3 0.00% 99.92% 0.00% 100.00% 0.00% 0x2000000000010a41 0x2000000000010a41
3 0.00% 99.92% 66.67% 33.33% 0.00% 0x20000000000110c0 0x20000000000110c0
3 0.00% 99.92% 0.00% 0.00% 100.00% 0x20000000001dfa00 0x20000000001dfa00
3 0.00% 99.93% 100.00% 0.00% 0.00% 0x200000000032d740 0x200000000032d740
3 0.00% 99.93% 0.00% 100.00% 0.00% 0x200000000032fad0 0x200000000032fad0
2 0.00% 99.93% 0.00% 0.00% 100.00% 0x20000000000231d1 0x20000000000231d1
2 0.00% 99.93% 50.00% 50.00% 0.00% 0x2000000000010770 0x2000000000010770
2 0.00% 99.93% 0.00% 100.00% 0.00% 0x2000000000015020 0x2000000000015020
2 0.00% 99.93% 50.00% 50.00% 0.00% 0x2000000000014610 0x2000000000014610
2 0.00% 99.93% 0.00% 100.00% 0.00% 0x2000000000021850 0x2000000000021850
2 0.00% 99.93% 100.00% 0.00% 0.00% 0x2000000000014a20 0x2000000000014a20
2 0.00% 99.93% 100.00% 0.00% 0.00% 0x2000000000011090 0x2000000000011090
2 0.00% 99.93% 100.00% 0.00% 0.00% 0x2000000000014ba0 0x2000000000014ba0
2 0.00% 99.93% 0.00% 50.00% 50.00% 0x2000000000010f10 0x2000000000010f10
2 0.00% 99.94% 50.00% 50.00% 0.00% 0x2000000000018451 0x2000000000018451
2 0.00% 99.94% 0.00% 0.00% 100.00% 0x2000000000010f20 0x2000000000010f20
2 0.00% 99.94% 0.00% 100.00% 0.00% 0x20000000000126d0 0x20000000000126d0
2 0.00% 99.94% 100.00% 0.00% 0.00% 0x200000000012f781 0x200000000012f781
2 0.00% 99.94% 0.00% 100.00% 0.00% 0x20000000001906f1 0x20000000001906f1
2 0.00% 99.94% 100.00% 0.00% 0.00% 0x20000000000109e0 0x20000000000109e0
2 0.00% 99.94% 0.00% 0.00% 100.00% 0x20000000001deba0 0x20000000001deba0
2 0.00% 99.94% 50.00% 0.00% 50.00% 0x20000000002a4481 0x20000000002a4481
2 0.00% 99.94% 0.00% 100.00% 0.00% 0x2000000000190780 0x2000000000190780
2 0.00% 99.94% 0.00% 50.00% 50.00% 0x2000000000017d41 0x2000000000017d41
2 0.00% 99.94% 0.00% 100.00% 0.00% 0x20000000002b1ff1 0x20000000002b1ff1
2 0.00% 99.94% 100.00% 0.00% 0.00% 0x200000000013c7d1 0x200000000013c7d1
2 0.00% 99.95% 50.00% 50.00% 0.00% 0x200000000032d640 0x200000000032d640
2 0.00% 99.95% 0.00% 100.00% 0.00% 0x200000000032bc61 0x200000000032bc61
2 0.00% 99.95% 50.00% 50.00% 0.00% 0x200000000032a030 0x200000000032a030
2 0.00% 99.95% 100.00% 0.00% 0.00% 0x200000000032a450 0x200000000032a450
2 0.00% 99.95% 100.00% 0.00% 0.00% 0x200000000032fb70 0x200000000032fb70
2 0.00% 99.95% 100.00% 0.00% 0.00% 0x200000000032fac1 0x200000000032fac1
2 0.00% 99.95% 50.00% 50.00% 0.00% 0x2000000000083b30 0x2000000000083b30
1 0.00% 99.95% 100.00% 0.00% 0.00% 0x2000000000005330 0x2000000000005330
1 0.00% 99.95% 0.00% 100.00% 0.00% 0x200000000000c3d0 0x200000000000c3d0
1 0.00% 99.95% 100.00% 0.00% 0.00% 0x200000000000c530 0x200000000000c530
1 0.00% 99.95% 100.00% 0.00% 0.00% 0x20000000000165b0 0x20000000000165b0
1 0.00% 99.95% 0.00% 100.00% 0.00% 0x20000000000246d1 0x20000000000246d1
1 0.00% 99.95% 100.00% 0.00% 0.00% 0x20000000000059f0 0x20000000000059f0
1 0.00% 99.95% 0.00% 100.00% 0.00% 0x20000000000062e0 0x20000000000062e0
1 0.00% 99.95% 100.00% 0.00% 0.00% 0x20000000000216f0 0x20000000000216f0
1 0.00% 99.95% 100.00% 0.00% 0.00% 0x2000000000010e30 0x2000000000010e30
1 0.00% 99.96% 0.00% 100.00% 0.00% 0x2000000000014d81 0x2000000000014d81
1 0.00% 99.96% 0.00% 100.00% 0.00% 0x2000000000021800 0x2000000000021800
1 0.00% 99.96% 0.00% 100.00% 0.00% 0x2000000000006400 0x2000000000006400
1 0.00% 99.96% 100.00% 0.00% 0.00% 0x2000000000011f40 0x2000000000011f40
1 0.00% 99.96% 0.00% 100.00% 0.00% 0x2000000000014d71 0x2000000000014d71
1 0.00% 99.96% 100.00% 0.00% 0.00% 0x2000000000018441 0x2000000000018441
1 0.00% 99.96% 0.00% 0.00% 100.00% 0x2000000000019070 0x2000000000019070
1 0.00% 99.96% 100.00% 0.00% 0.00% 0x20000000001356e1 0x20000000001356e1
1 0.00% 99.96% 100.00% 0.00% 0.00% 0x20000000000107c1 0x20000000000107c1
1 0.00% 99.96% 100.00% 0.00% 0.00% 0x2000000000010a10 0x2000000000010a10
1 0.00% 99.96% 0.00% 100.00% 0.00% 0x2000000000010e00 0x2000000000010e00
1 0.00% 99.96% 0.00% 100.00% 0.00% 0x2000000000010a11 0x2000000000010a11
1 0.00% 99.96% 0.00% 100.00% 0.00% 0x2000000000018ce1 0x2000000000018ce1
1 0.00% 99.96% 0.00% 100.00% 0.00% 0x2000000000010f21 0x2000000000010f21
1 0.00% 99.96% 0.00% 100.00% 0.00% 0x2000000000018c30 0x2000000000018c30
1 0.00% 99.96% 100.00% 0.00% 0.00% 0x200000000000e6b0 0x200000000000e6b0
1 0.00% 99.96% 0.00% 100.00% 0.00% 0x20000000000171d1 0x20000000000171d1
1 0.00% 99.96% 100.00% 0.00% 0.00% 0x2000000000010f50 0x2000000000010f50
1 0.00% 99.96% 0.00% 0.00% 100.00% 0x2000000000044741 0x2000000000044741
1 0.00% 99.96% 0.00% 0.00% 100.00% 0x20000000002d83a1 0x20000000002d83a1
1 0.00% 99.96% 0.00% 100.00% 0.00% 0x20000000002a4d10 0x20000000002a4d10
1 0.00% 99.96% 0.00% 100.00% 0.00% 0x20000000000841e1 0x20000000000841e1
1 0.00% 99.96% 100.00% 0.00% 0.00% 0x20000000002a4e00 0x20000000002a4e00
1 0.00% 99.96% 0.00% 100.00% 0.00% 0x2000000000017e81 0x2000000000017e81
1 0.00% 99.97% 0.00% 0.00% 100.00% 0x20000000002a3f81 0x20000000002a3f81
1 0.00% 99.97% 0.00% 0.00% 100.00% 0x2000000000017d20 0x2000000000017d20
1 0.00% 99.97% 0.00% 100.00% 0.00% 0x20000000000109f0 0x20000000000109f0
1 0.00% 99.97% 0.00% 100.00% 0.00% 0x20000000002a6ca0 0x20000000002a6ca0
1 0.00% 99.97% 100.00% 0.00% 0.00% 0x2000000000017f70 0x2000000000017f70
1 0.00% 99.97% 100.00% 0.00% 0.00% 0x20000000002a7b11 0x20000000002a7b11
1 0.00% 99.97% 0.00% 100.00% 0.00% 0x2000000000017d21 0x2000000000017d21
1 0.00% 99.97% 100.00% 0.00% 0.00% 0x20000000002acb90 0x20000000002acb90
1 0.00% 99.97% 100.00% 0.00% 0.00% 0x20000000002a6770 0x20000000002a6770
1 0.00% 99.97% 100.00% 0.00% 0.00% 0x2000000000132290 0x2000000000132290
1 0.00% 99.97% 0.00% 100.00% 0.00% 0x20000000002a4cd0 0x20000000002a4cd0
1 0.00% 99.97% 0.00% 100.00% 0.00% 0x20000000002a43a1 0x20000000002a43a1
1 0.00% 99.97% 0.00% 100.00% 0.00% 0x20000000000109e1 0x20000000000109e1
1 0.00% 99.97% 100.00% 0.00% 0.00% 0x20000000002a4321 0x20000000002a4321
1 0.00% 99.97% 100.00% 0.00% 0.00% 0x2000000000084190 0x2000000000084190
1 0.00% 99.97% 100.00% 0.00% 0.00% 0x2000000000011b41 0x2000000000011b41
1 0.00% 99.97% 0.00% 100.00% 0.00% 0x200000000010e4d1 0x200000000010e4d1
1 0.00% 99.97% 100.00% 0.00% 0.00% 0x20000000002a4461 0x20000000002a4461
1 0.00% 99.97% 100.00% 0.00% 0.00% 0x200000000013a1f0 0x200000000013a1f0
1 0.00% 99.97% 100.00% 0.00% 0.00% 0x20000000002a4201 0x20000000002a4201
1 0.00% 99.97% 100.00% 0.00% 0.00% 0x20000000002b27a0 0x20000000002b27a0
1 0.00% 99.97% 0.00% 100.00% 0.00% 0x20000000002a3da1 0x20000000002a3da1
1 0.00% 99.97% 100.00% 0.00% 0.00% 0x20000000002a4301 0x20000000002a4301
1 0.00% 99.98% 0.00% 100.00% 0.00% 0x2000000000132860 0x2000000000132860
1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000002a4021 0x20000000002a4021
1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000002b1ff0 0x20000000002b1ff0
1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000002a4741 0x20000000002a4741
1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000002a3f01 0x20000000002a3f01
1 0.00% 99.98% 100.00% 0.00% 0.00% 0x200000000013cb70 0x200000000013cb70
1 0.00% 99.98% 0.00% 0.00% 100.00% 0x20000000001906b0 0x20000000001906b0
1 0.00% 99.98% 0.00% 0.00% 100.00% 0x200000000012f7b1 0x200000000012f7b1
1 0.00% 99.98% 0.00% 100.00% 0.00% 0x20000000001321c1 0x20000000001321c1
1 0.00% 99.98% 0.00% 100.00% 0.00% 0x20000000001314a0 0x20000000001314a0
1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000002a4210 0x20000000002a4210
1 0.00% 99.98% 100.00% 0.00% 0.00% 0x2000000000132240 0x2000000000132240
1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000002a4430 0x20000000002a4430
1 0.00% 99.98% 100.00% 0.00% 0.00% 0x200000000013ce11 0x200000000013ce11
1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000001308d1 0x20000000001308d1
1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000001d0ea1 0x20000000001d0ea1
1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000002b1b70 0x20000000002b1b70
1 0.00% 99.98% 100.00% 0.00% 0.00% 0x2000000000131a20 0x2000000000131a20
1 0.00% 99.98% 0.00% 100.00% 0.00% 0x20000000001318b0 0x20000000001318b0
1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000002b1e00 0x20000000002b1e00
1 0.00% 99.98% 100.00% 0.00% 0.00% 0x20000000002a4810 0x20000000002a4810
1 0.00% 99.98% 100.00% 0.00% 0.00% 0x2000000000017e60 0x2000000000017e60
1 0.00% 99.98% 0.00% 100.00% 0.00% 0x4000000000002600 main+0x150<rdma_lat>
1 0.00% 99.99% 0.00% 100.00% 0.00% 0x20000000001317b1 0x20000000001317b1
1 0.00% 99.99% 0.00% 100.00% 0.00% 0x2000000000010df0 0x2000000000010df0
1 0.00% 99.99% 0.00% 100.00% 0.00% 0x2000000000045c80 0x2000000000045c80
1 0.00% 99.99% 0.00% 0.00% 100.00% 0x200000000012f701 0x200000000012f701
1 0.00% 99.99% 0.00% 100.00% 0.00% 0x4000000000001290 _init+0x50<rdma_lat>
1 0.00% 99.99% 0.00% 0.00% 100.00% 0x20000000000e0560 0x20000000000e0560
1 0.00% 99.99% 100.00% 0.00% 0.00% 0x2000000000017e20 0x2000000000017e20
1 0.00% 99.99% 0.00% 100.00% 0.00% 0x4000000000003650 main+0x11a0<rdma_lat>
1 0.00% 99.99% 100.00% 0.00% 0.00% 0x20000000000e51f1 0x20000000000e51f1
1 0.00% 99.99% 0.00% 100.00% 0.00% 0x2000000000017d00 0x2000000000017d00
1 0.00% 99.99% 0.00% 100.00% 0.00% 0x20000000000b3660 0x20000000000b3660
1 0.00% 99.99% 0.00% 0.00% 100.00% 0x20000000000424e1 0x20000000000424e1
1 0.00% 99.99% 0.00% 0.00% 100.00% 0x200000000012d051 0x200000000012d051
1 0.00% 99.99% 0.00% 100.00% 0.00% 0x200000000032ba40 0x200000000032ba40
1 0.00% 99.99% 0.00% 100.00% 0.00% 0x200000000032be50 0x200000000032be50
1 0.00% 99.99% 100.00% 0.00% 0.00% 0x200000000032d8b0 0x200000000032d8b0
1 0.00% 99.99% 100.00% 0.00% 0.00% 0x200000000032a201 0x200000000032a201
1 0.00% 99.99% 100.00% 0.00% 0.00% 0x200000000032be10 0x200000000032be10
1 0.00% 99.99% 0.00% 100.00% 0.00% 0x4000000000003f81 main+0x1ad1<rdma_lat>
1 0.00% 99.99% 0.00% 100.00% 0.00% 0x200000000032ba50 0x200000000032ba50
1 0.00% 99.99% 0.00% 100.00% 0.00% 0x200000000032bc01 0x200000000032bc01
1 0.00% 99.99% 0.00% 100.00% 0.00% 0x4000000000003f91 main+0x1ae1<rdma_lat>
1 0.00% 99.99% 0.00% 100.00% 0.00% 0x200000000032bc60 0x200000000032bc60
1 0.00% 100.00% 100.00% 0.00% 0.00% 0x200000000032b570 0x200000000032b570
1 0.00% 100.00% 100.00% 0.00% 0.00% 0x200000000032a441 0x200000000032a441
1 0.00% 100.00% 100.00% 0.00% 0.00% 0x200000000032a210 0x200000000032a210
1 0.00% 100.00% 100.00% 0.00% 0.00% 0x200000000013f311 0x200000000013f311
1 0.00% 100.00% 100.00% 0.00% 0.00% 0x200000000012faf0 0x200000000012faf0
1 0.00% 100.00% 0.00% 100.00% 0.00% 0x200000000012c181 0x200000000012c181
1 0.00% 100.00% 100.00% 0.00% 0.00% 0x20000000000ae341 0x20000000000ae341
1 0.00% 100.00% 100.00% 0.00% 0.00% 0x20000000000ae340 0x20000000000ae340
1 0.00% 100.00% 100.00% 0.00% 0.00% 0x20000000000db490 0x20000000000db490
1 0.00% 100.00% 0.00% 100.00% 0.00% 0x20000000000ef5d0 0x20000000000ef5d0
1 0.00% 100.00% 0.00% 0.00% 100.00% 0x2000000000019620 0x2000000000019620
1 0.00% 100.00% 100.00% 0.00% 0.00% 0x20000000000198d1 0x20000000000198d1
# level 0 : counts=116599 avg_cycles=0.0ms 50.38%
# level 1 : counts=57736 avg_cycles=0.0ms 24.95%
# level 2 : counts=57093 avg_cycles=0.0ms 24.67%
approx cost: 0.0s
More information about the general
mailing list