[ofa-general] US Case 00012515: problems with epoll and ipoib (memory leak and cpu creep) [[ ref:00D38IO.50085NTZf:ref ]]

[Motty Grosman]

 Hi Murray,  

1. As we spoke, please use this link to the pre-released VMA:
 
www.voltaire.com/ftp/support-products/Tradewox/libvma-2.1.8-0-RH-x86_64.
rpm

2. In general while using VMA  the cpu utilization is rises, 
 please find attached  "VMA optimization guide" aim to optimize your
system and the performance

BDW- when using the VMA, make sure the "umcast" flag is enable
Please look at VMA optimization guide for more details 

Should you have any further question, please let me know.

Best Regards,


Motty Grosman   |  +978-439-5428   |   +978-9955-978(m)

System Engineer

Voltaire - The Grid Backbone

www.voltaire.com


-----Original Message-----
From: murray smigel [mailto:murray at tradeworx.com] 
Sent: Thursday, October 16, 2008 13:21
To: general at lists.openfabrics.org; support; Joohan Lee
Subject: problems with epoll and ipoib (memory leak and cpu creep)

Hi,
We have an application using epoll to listen to a group of udp multicast
broadcasts that come in over a set of ethernet ports built into a
Voltaire ISR2004 switch via the IPR module.  The IPR ports are assigned
ethernet addresses and routing is set up to listen to the multicasts
over the appropriate IPR port.  There are a large number of multicast
groups involved ~100 distributed over two IPR ports.

When we run the application using poll, things work fine (except for the
occasional dropping of packets due to the large set of fds passed to
poll).  To try to remedy the problem, we switched to epoll.  Now, as the
program runs, the cpu utilization rises over time towards 100% and the
memory usage grows as well.

The same epoll based program runs fine when it is on a machine with
physical ethernet ports
(eth1 eth2) rather then ipoib mapped IPR ports (ib0.8200, ib0.8600).

Hardware is x86-64 based dualxdual core intel processors.
We are running Debian Etch with a vanilla 2.6.26.5 kernel and the ofed
stack that is part of the standard kernel distro.

Any analysis or suggestions would be appreciated.

thanks,
murray smigel


-------------- next part --------------
A non-text attachment was scrubbed...
Name: VMA_User_Manual_DOC-00393-A00.pdf
Type: application/octet-stream
Size: 548224 bytes
Desc: VMA_User_Manual_DOC-00393-A00.pdf
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20081016/3fe4fd45/attachment.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: VMA Optimizations.doc
Type: application/msword
Size: 58880 bytes
Desc: VMA Optimizations.doc
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20081016/3fe4fd45/attachment.doc>