[openib-general] Re: Re: Userspace testing results (manykernels, many svn trees)

Tue Jan 24 23:14:19 PST 2006

On 25.01.2006 [08:17:29 +0200], Michael S. Tsirkin wrote:
> Quoting r. Nishanth Aravamudan <nacc at us.ibm.com>:
> > Subject: Re: [openib-general] Re: Re: Userspace testing results (manykernels, many svn trees)
> > 
> > On 24.01.2006 [23:19:52 +0200], Michael S. Tsirkin wrote:
> > > Quoting r. Nishanth Aravamudan <nacc at us.ibm.com>:
> > > > Subject: Re: [openib-general] Re: Re: Userspace testing results (manykernels, many svn trees)
> > > > 
> > > > On 24.01.2006 [21:39:23 +0200], Michael S. Tsirkin wrote:
> > > > > Quoting r. Roland Dreier <rdreier at cisco.com>:
> > > > > > Subject: Re: [openib-general] Re: Re: Userspace testing results (manykernels, many svn trees)
> > > > > > 
> > > > > >     Michael> 1 sec = 5.37731e+14 usec
> > > > > > 
> > > > > >     Michael> which seems to indicate something's still wrong.
> > > > > > 
> > > > > > BTW this number is pretty close to 2^32 times bigger than 1e6, so the
> > > > > > problem is probably still using long long to return the result of
> > > > > > mftb (which will result in shifting the result by 32 bits, ie
> > > > > > multiplying by 2^32).
> > > > > 
> > > > > Hmm.
> > > > > Maybe make clean wasnt run after updating?
> > > > > Could it be un on rev 5174?
> > > > 
> > > > Heh, here's what happens with 5174:
> > > > 
> > > > Correlation coefficient r^2: 0.773428 < 0.9
> > > > 1 sec = inf usec
> > > > 1 sec = inf usec
> > > > 1 sec = inf usec
> > > > 1 sec = inf usec
> > > > 1 sec = inf usec
> > > > 1 sec = inf usec
> > > > 1 sec = inf usec
> > > > 1 sec = inf usec
> > > > 1 sec = inf usec
> > > > 1 sec = inf usec
> > > > 1 sec = inf usec
> > > > 1 sec = inf usec
> > > > 1 sec = inf usec
> > > > 1 sec = inf usec
> > > > 1 sec = inf usec
> > > > 1 sec = inf usec
> > > > 1 sec = inf usec
> > > > 
> > > > And so forth...
> > > > 
> > > > Thanks,
> > > > Nish
> > > 
> > > Hmm. Looks like mftb is returning wrong data.
> > > Could you uncomment lines setting DEBUG and DEBUG_DATA at the top?
> > > This will print all mftb values out.
> > 
> > Here you go:
> > 
> > x=100 y=21172
> > x=110 y=21985
> > x=120 y=23709
> > x=130 y=26136
> > x=140 y=27815
> > x=150 y=29919
> > x=160 y=32063
> > x=170 y=33921
> > x=180 y=35829
> > x=190 y=37941
> > x=200 y=40042
> > x=210 y=42064
> > x=220 y=43935
> > x=230 y=45957
> > x=240 y=47818
> > x=250 y=50004
> > x=260 y=51942
> > x=270 y=54173
> > x=280 y=56043
> > x=290 y=57951
> > x=300 y=59798
> > x=310 y=62034
> > x=320 y=63812
> > x=330 y=65928
> > x=340 y=67835
> > x=350 y=69929
> > x=360 y=71869
> > x=370 y=73876
> > x=380 y=75872
> > x=390 y=77927
> > x=400 y=79865
> > x=410 y=81923
> > x=420 y=84076
> > x=430 y=85937
> > x=440 y=87819
> > x=450 y=89999
> > x=460 y=91831
> > x=470 y=93975
> > x=480 y=95994
> > x=490 y=97743
> > x=500 y=99868
> > x=510 y=101917
> > x=520 y=103806
> > x=530 y=105724
> > x=540 y=107811
> > x=550 y=110012
> > x=560 y=111876
> > x=570 y=113934
> > x=580 y=115857
> > x=590 y=117735
> > x=600 y=119811
> > x=610 y=121907
> > x=620 y=124025
> > x=630 y=125983
> > x=640 y=127945
> > x=650 y=129729
> > x=660 y=131898
> > x=670 y=133723
> > x=680 y=135868
> > x=690 y=137742
> > x=700 y=139815
> > x=710 y=141800
> > x=720 y=143812
> > x=730 y=145768
> > x=740 y=147790
> > x=750 y=149935
> > x=760 y=151826
> > x=770 y=154003
> > x=780 y=155618
> > x=790 y=157746
> > x=800 y=159846
> > x=810 y=161874
> > x=820 y=163914
> > x=830 y=165901
> > x=840 y=167634
> > x=850 y=169793
> > x=860 y=171833
> > x=870 y=173895
> > x=880 y=175657
> > x=890 y=177807
> > x=900 y=179827
> > x=910 y=181875
> > x=920 y=183834
> > x=930 y=185884
> > x=940 y=187860
> > x=950 y=189922
> > x=960 y=191883
> > x=974 y=194497
> > x=980 y=195672
> > x=990 y=197907
> > x=1000 y=199626
> > x=1010 y=201735
> > x=1020 y=203874
> > x=1030 y=205728
> > x=1040 y=207861
> > x=1050 y=209737
> > x=1060 y=211836
> > x=1070 y=213749
> > x=1080 y=215880
> > x=1090 y=217817
> > x=1100 y=219729
> > x=1110 y=221755
> > x=1120 y=223704
> > x=1130 y=225783
> > x=1140 y=227729
> > x=1150 y=229786
> > x=1160 y=232030
> > x=1170 y=233770
> > x=1180 y=235803
> > x=1190 y=237791
> > x=1200 y=239841
> > x=1210 y=241768
> > x=1220 y=243862
> > x=1230 y=245735
> > x=1240 y=247678
> > x=1250 y=249795
> > x=1260 y=251850
> > x=1270 y=253771
> > x=1280 y=255840
> > x=1290 y=257928
> > x=1300 y=259880
> > x=1310 y=261752
> > x=1320 y=263702
> > x=1330 y=265601
> > x=1340 y=267671
> > x=1350 y=269570
> > x=1360 y=271756
> > x=1370 y=273750
> > x=1380 y=275702
> > x=1390 y=277765
> > x=1400 y=279695
> > x=1410 y=281620
> > x=1420 y=283692
> > x=1430 y=285587
> > x=1440 y=287872
> > x=1450 y=289621
> > x=1460 y=291676
> > x=1470 y=293590
> > x=1480 y=295702
> > x=1490 y=297790
> > x=1500 y=299529
> > x=1510 y=301597
> > x=1520 y=303741
> > x=1530 y=305806
> > x=1540 y=307870
> > x=1550 y=309780
> > x=1560 y=311539
> > x=1570 y=313756
> > x=1580 y=315725
> > x=1590 y=317589
> > x=1600 y=319559
> > x=1610 y=321651
> > x=1620 y=323878
> > x=1630 y=325848
> > x=1640 y=327742
> > x=1650 y=329615
> > x=1660 y=331551
> > x=1670 y=333784
> > x=1680 y=335505
> > x=1690 y=337610
> > x=1700 y=339742
> > x=1710 y=341609
> > x=1720 y=343717
> > x=1730 y=345641
> > x=1740 y=347780
> > x=1750 y=349626
> > x=1760 y=351749
> > x=1770 y=353782
> > x=1780 y=355740
> > x=1790 y=357413
> > x=1800 y=359755
> > x=1810 y=361621
> > x=1820 y=363584
> > x=1830 y=365768
> > x=1840 y=367582
> > x=1850 y=369810
> > x=1860 y=371521
> > x=1870 y=373702
> > x=1880 y=375905
> > x=1890 y=377659
> > x=1900 y=379704
> > x=1910 y=381626
> > x=1920 y=383601
> > x=1930 y=385635
> > x=1940 y=387715
> > x=1950 y=389671
> > x=1960 y=391704
> > x=1970 y=393599
> > x=1980 y=395572
> > x=1990 y=397692
> > x=2000 y=399776
> > x=2010 y=401853
> > x=2020 y=403711
> > x=2030 y=405478
> > x=2040 y=407577
> > x=2050 y=409618
> > x=2060 y=411603
> > x=2070 y=413642
> > x=2080 y=415601
> > x=2090 y=417823
> > a = -8.02523
> > b = 199.818
> > a / b = -0.0401626
> > r^2 = 0.999999
> > Warning: measured timestamp frequency 199.818 differs from nominal 1600 MHz
> > 1 sec = 1.00195e+06 usec
> > 1 sec = 1.00198e+06 usec
> > 1 sec = 1.00207e+06 usec
> > 1 sec = 1.00207e+06 usec
> > 1 sec = 1.00207e+06 usec
> > 1 sec = 1.00207e+06 usec
> > 1 sec = 1.00207e+06 usec
> > 1 sec = 1.00207e+06 usec
> > 1 sec = 1.00207e+06 usec
> > 1 sec = 1.00207e+06 usec
> 
> Seems to work fine now ... what changed?
> Time to try rdma_lat/rdma_bw I guess.

Yes, I saw the same thing and was confused. Admittedly, this was a few
times after running clock_test. I'll try again after the next set of
jobs and see if maybe at some point it fails transiently.

> > Just an FYI, when I tried redirecting stdout and stderr to a file, the
> > program never would print the "1 sec = ..." lines. If I just redirect
> > stderr (which I had to grab all the numbers above), it works fine. Dunno
> > what's up with that or if it's just a problem on my end.
> 
> Probably, I'm just using stderr/stdout.

Not a huge deal, I'll try and debug here.

Thanks,
Nish