[openib-general] mvapich2 pmi scalability problems

[Don.Dhondt at Bull.com]

Matthew,

We build mvapich2 using the make.mvapich2.gen2 script.
Within that script file is the fillowing:
# Whether to use an optimized queue pair exchange scheme.  This is not
# checked for a setting in in the script.  It must be set here explicitly.
# Supported: "-DUSE_MPD_RING" and "" (to disable)
if [ $ARCH = "_PPC64_" ]; then
        HAVE_MPD_RING=""
else
        HAVE_MPD_RING="-DUSE_MPD_RING"
fi

Since we are compiling for ia64 our assumption is it compiled with 
HAVE_MPD_RING="-DUSE_MPD_RING". Is this correct?
Also, we are not using mpd to run start the jobs. Since we are
using slurm as the resource manager the jobs are started with
srun. Does MPD_RING on apply if using MDP?

-Don




Matthew Koop <koop at cse.ohio-state.edu> 
07/21/2006 11:51 AM

To
Don.Dhondt at Bull.com
cc
openib-general at openib.org
Subject
Re: [openib-general] mvapich2 pmi scalability problems






Don,

Are you using the USE_MPD_RING flag when compiling? If not, can you give
that a try? It should very significantly decrease the number of PMI calls
that are made.

Thanks,

Matthew Koop






-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20060721/1f66aa1f/attachment.html>