[openib-general] Re: Userspace testing results (many kernels, many svn trees)

[Nishanth Aravamudan]

On 23.01.2006 [15:19:59 +0200], Michael S. Tsirkin wrote:
> Quoting r. Nishanth Aravamudan <nacc at us.ibm.com>:
> > Subject: Re: Userspace testing results (many kernels,many svn trees)
> > 
> > On 09.01.2006 [08:33:01 +0200], Michael S. Tsirkin wrote:
> > > Quoting r. Nishanth Aravamudan <nacc at us.ibm.com>:
> > > > Just like with the results I posted earlier, all the perftest results
> > > > are seriously wrong for 32-bit clients (with both 32-bit and 64-bit
> > > > servers). I am not sure who else to notify beyond the general list (is
> > > > there a corresponding MAINTAINERS files like in the kernel proper for
> > > > the OpenIB code?)
> > > 
> > > That would be me - sorry about the delay, I'll take a look at this.
> > > Thanks a lot, Nishanth!
> > > This work is very much appreciated.
> > 
> > No worries, hope the problem is not too hard to fix :)
> 
> OK, I'm going to concentrate on rdma_lat/rdma_bw for now.
> 
> # file ./rdma_bw
> ./rdma_bw: ELF 32-bit LSB executable, Intel 80386, version 1 (SYSV), for GNU/Linux 2.2.5, dynamically linked (uses shared libs), not stripped
> 
> # ./rdma_bw swlab155
>   local address:  LID 0xd9, QPN 0x24040a, PSN 0x98e7f4 RKey 0xe0003f VAddr 0x000000556db000
>   remote address: LID 0xd9, QPN 0x240406, PSN 0x952ea0, RKey 0xe00033 VAddr 0x000000556db000
> Bandwidth peak (#0 to #999): 879.956 MB/sec
> Bandwidth average: 879.954 MB/sec
> Service Demand peak (#0 to #999): 3773 cycles/KB
> Service Demand Avg  : 37 cycles/KB
> 
> Seems like I cant reproduce the problem. Which distribution
> and CPU architecture is this, again?

The machines are running ppc64 kernels. They are both SLES9-SP2
userspace setups, with the infiniband components being updated to the
current svn.

Bah, I just noticed that perftests doesn't even build right now (svn
5130).

on ppc32 machines:

/usr/local/autobench/var/tmp/gen2-trunk/userspace/perftest
patching file Makefile
gcc -m32 -m32 -I/usr/local/autobench/var/tmp/out/ppc32/include -Wall -O2 -g -D_GNU_SOURCE   -m32 -L/lib -L/usr/local/autobench/var/tmp/out/ppc32/lib   rdma_lat.c get_clock.c -libverbs  -o rdma_lat
In file included from rdma_lat.c:57:
get_clock.h:50:27: operator '||' has no right operand
get_clock.h:73:2: warning: #warning get_cycles not implemented for this architecture: attempt asm/timex.h
rdma_lat.c:517: error: parse error before "get_median"
rdma_lat.c:517: error: parse error before "cycles_t"
rdma_lat.c:518: warning: return type defaults to `int'
rdma_lat.c: In function `get_median':
rdma_lat.c:519: error: `n' undeclared (first use in this function)
rdma_lat.c:519: error: (Each undeclared identifier is reported only once
rdma_lat.c:519: error: for each function it appears in.)
rdma_lat.c:520: error: `delta' undeclared (first use in this function)
rdma_lat.c: In function `cycles_compare':
rdma_lat.c:527: error: syntax error before '*' token
rdma_lat.c:528: error: syntax error before '*' token
rdma_lat.c:529: error: `a' undeclared (first use in this function)
rdma_lat.c:529: error: `b' undeclared (first use in this function)
rdma_lat.c: At top level:
rdma_lat.c:535: error: parse error before "cycles_t"
rdma_lat.c: In function `print_report':
rdma_lat.c:538: error: `cycles_t' undeclared (first use in this function)
rdma_lat.c:538: error: parse error before "median"
rdma_lat.c:541: error: `delta' undeclared (first use in this function)
rdma_lat.c:541: error: `iters' undeclared (first use in this function)
rdma_lat.c:549: error: `tstamp' undeclared (first use in this function)
rdma_lat.c:552: error: `options' undeclared (first use in this function)
rdma_lat.c:574: error: `median' undeclared (first use in this function)
rdma_lat.c: In function `main':
rdma_lat.c:605: error: `cycles_t' undeclared (first use in this function)
rdma_lat.c:605: error: `tstamp' undeclared (first use in this function)
rdma_lat.c:747: warning: implicit declaration of function `get_cycles'
make: *** [rdma_lat] Error 1

on ppc64 machines:

gcc -m64 -m64 -I/usr/local/autobench/var/tmp/out/ppc64/include -Wall -O2 -g -D_GNU_SOURCE   -m64 -L/lib64 -L/usr/local/autobench/var/tmp/out/ppc64/lib   rdma_lat.c get_clock.c -libverbs  -o rdma_lat
In file included from rdma_lat.c:57:
get_clock.h:50:27: operator '||' has no right operand
get_clock.h:73:2: warning: #warning get_cycles not implemented for this architecture: attempt asm/timex.h
make: *** [rdma_lat] Error 1

Once we get that sorted out, I can re-verify that perftest is/isn't
broken still.

Thanks,
Nish