[ofa-general] Obtaining RDMA statistics for an InfiniBand interface

[Pawel Dziekonski]

On Tue, 18 Mar 2008 at 05:53:06AM -0700, Hal Rosenstock wrote:
> On Tue, 2008-03-18 at 09:17 +0100, Bart Van Assche wrote:
> > On Mon, Mar 17, 2008 at 6:07 PM, Boris Shpolyansky <boris at mellanox.com> wrote:
> > > Check :
> > >
> > >  /sys/class/infiniband/[mlx4_*|mthca*]/ports/*/counters/*
> > 
> > Thanks, these are interesting counters. Unfortunately these counters
> > are 32-bit counters and already overflowed during the test I ran (less
> > than one day of SRP communication):
> > 
> > $ uname -r
> > 2.6.24
> > $ uname -m
> > x86_64
> > $ head /sys/class/infiniband/mthca0/ports/1/counters/*_{data,packets}
> > ==> /sys/class/infiniband/mthca0/ports/1/counters/port_rcv_data <==
> > 4294967295
> > 
> > ==> /sys/class/infiniband/mthca0/ports/1/counters/port_xmit_data <==
> > 4294967295
> > 
> > ==> /sys/class/infiniband/mthca0/ports/1/counters/port_rcv_packets <==
> > 4294967295
> > 
> > ==> /sys/class/infiniband/mthca0/ports/1/counters/port_xmit_packets <==
> > 4294967295
> 
> Depending on which fabric management (usually bundled with the SM) is
> being used, you may be able to obtain this information via the
> Performance Manager (and not be limited to 32 bit counters).

Hi,

I have exactly the same problem on OFED 1.2.5.5, redhat kernel
2.6.9-55.0.12.ELsmp on X86_64 machines. {data,packets} files contain
4294967295 value, or barely change. :(

How can I get Performance Manager running and printing some reasonable
numbers?

regards, P
-- 
Pawel Dziekonski <pawel.dziekonski at wcss.pl>
Wroclaw Centre for Networking & Supercomputing, HPC Department
Politechnika Wr., pl. Grunwaldzki 9, bud. D2/101, 50-377 Wroclaw, POLAND
phone: +48 71 3202043, fax: +48 71 3225797, http://www.wcss.wroc.pl