[openib-general] Problem running mpdboot command in MVAPICH2 v0.9.3-RC0

[wei huang]

Hi Albert,

It seems a bit weird that you cannot find the library while the path is
included in LD_LIBRARY_PATH. In order to make sure that this is not an
environment setup problem, would you please do a small test:

>From one of your cluster nodes:

ssh $mc ibv_devinfo

$mc is all the machines that are in your hostfile. If everything is fine,
you should be able to ssh to each machine and get infiniband device
information.

Thanks.

Regards,
Wei Huang

774 Dreese Lab, 2015 Neil Ave,
Dept. of Computer Science and Engineering
Ohio State University
OH 43210
Tel: (614)292-8501


On Mon, 1 May 2006, Albert To wrote:

> Hi Matthew,
>
> Thanks for helping out on this issue.  As requested, the info is
> attached.
>
> Note:  The info was obtained from compilations of v0.9.2 and v0.9.3
> back-to-back.  Thus, system and setup are exactly the same.  Afterwards,
> mpdboot works on v0.9.2 but NOT v0.9.3
>
> Thanks,
> Albert
>
> -----Original Message-----
> From: Matthew Koop [mailto:koop at cse.ohio-state.edu]
> Sent: Monday, May 01, 2006 6:56 PM
> To: Albert To
> Cc: wei huang; openib-general at openib.org
> Subject: RE: [openib-general] Problem running mpdboot command in
> MVAPICH2 v0.9.3-RC0
>
> Albert,
>
> Has anything changed with your system since compiling MVAPICH2? I'm a
> bit confused why it would have worked with 0.9.2 and not 0.9.3-RC0.
> There wasn't any change between 0.9.2 and 0.9.3-RC0 that should create
> this type of issue.
>
> Can you try re-compiling and re-running? If you could also send along
> the configure.log generated it may help us look into this issue. Also,
> can you just send the output from ls -l /usr/local/lib, just to make
> sure there isn't any problems there?
>
> Thanks,
>
> Matthew Koop
>
> -
> Network-Based Computing Laboratory
> Ohio State University
>
>
>
> > Hi Wei,
> >
> > Thanks for a prompt reply.
> >
> > Yes, I did originally export the LD_LIBRARY_PATH in .bashrc as
> followed:
> > export LD_LIBRARY_PATH=/usr/local/lib
> >
> > I've also tried your suggestion:
> > export LD_LIBRARY_PATH=/usr/local/lib:$LD_LIBRARY_PATH
> >
> > In either case, issue still exists.  Given the same setup, I did NOT
> > see this issue in v0.9.2 (obtained from
> > https://openib.org/svn/gen2/trunk/src/userspace/mpi/mvapich2-gen2).
> >
> > Thanks,
> > Albert
> >
> > ----Original Message-----
> > From: wei huang [mailto:huanwei at cse.ohio-state.edu]
> > Sent: Saturday, April 29, 2006 2:09 PM
> > To: Albert To
> > Cc: openib-general at openib.org
> > Subject: Re: [openib-general] Problem running mpdboot command in
> > MVAPICH2 v0.9.3-RC0
> >
> > Hi Albert,
> >
> > Not sure if you export /usr/local/lib to LD_LIBRARY_PATH manually or
> > it is in your bashrc.
> >
> > Could you please try to put
> > export LD_LIBRARY_PATH=/usr/local/lib:$LD_LIBRARY_PATH
> >
> > in your .bashrc (assume using bash) and try again?
> >
> > Thanks.
> >
> > Regards,
> > Wei Huang
> >
> > 774 Dreese Lab, 2015 Neil Ave,
> > Dept. of Computer Science and Engineering Ohio State University OH
> > 43210
> > Tel: (614)292-8501
> >
> >
> > On Fri, 28 Apr 2006, Albert To wrote:
> >
> > > Hi,
> > >
> > > I downloaded and compiled the MVAPICH2 v0.9.3-RC0 using
> > > make.mvapich2.gen2 script.  The script finished without any errors.
> > > However, I received "mpdboot: error while loading shared libraries:
> > > libibverbs.so.1: cannot open shared object file: No such file or
> > > directory" error while executing mpdboot -n 2 -f mpd.hosts.  I
> > > checked
> >
> > > library file libibverbs.so.1 and found it in /usr/local/lib folder.
> > > LD_LIBRARY_PATH is already set to /usr/local/bin, but that didn't
> > help.
> > >
> > > Is there another environment variable that I need to set to make
> > > mpdboot works?  Thanks in advance for your help.
> > >
> > > -Albert
> > >
> >
> >
> >
> > _______________________________________________
> > openib-general mailing list
> > openib-general at openib.org
> > http://openib.org/mailman/listinfo/openib-general
> >
> > To unsubscribe, please visit
> > http://openib.org/mailman/listinfo/openib-general
> >
>
>
>