[ofa-general] OOM problem with ib_ipoib?

Roland Dreier rdreier at cisco.com
Tue Oct 28 14:31:33 PDT 2008


 > MemTotal:     33274492 kB
 ...
 > LowTotal:       638684 kB

It looks as if you have a box with 32G of RAM running a 32-bit kernel,
which means low (direct kernel-mapped) memory is extremely tight.  IPoIB
connected mode ties up a signifcant amount of memory in the receive
queue -- perhaps around 64M, which is 10% of low memory for you.  So
loading IPoIB may push you past the tipping point where things really
break easily.

I'm not surprised that you run into memory management problems with such
a system -- 32-bit kernels really have a hard time coping with such an
inbalance between total memory and low memory.  The simplest solution
would probably be to switch to a 64-bit kernel -- note that you don't
have to change any userspace, just use a 64-bit kernel.

 - R.



More information about the general mailing list