[openib-general] Re: [openfabrics-ewg] IBED-1.0-rc3 installer feedback

Sun Apr 16 08:05:00 PDT 2006

Hi Scott,
Thanks for your feedback, see my comments inside marked with [VS].

Regards,
Vladimir

Scott Weitzenkamp (sweitzen) wrote:
> Here's some feedback on installation, should I file bugs/enhancements in
> bugzilla for these?
>
> 0) build.sh does not compile Open MPI, forcing me to run install.sh to
> compile Open MPI.  This makes it harder to set up a build server used to
> just compile the code for installation elsewhere.
>
>   
[VS] Open MPI RPM package (current version) can be built if all required 
software already installed under final installation prefix.
          Then it can be done only during installation process (by 
running install.sh).
> 1) Too many references to Mellanox in the docs.
>   
[VS] README.txt and docs/IBED_Installation_Guide.txt were taken from 
previous releases of Mellanox software stacks and still not updated.
         They will be updated for the next OFED  RC.
> # fgrep Mellanox README.txt docs/IBED_Installation_Guide.txt
> README.txt:Mellanox IBED Distribution v1.0 for Linux
> README.txt:This is the Mellanox InfiniBand Distribution (IBED) ver. 1.0
> software
>  package.
> README.txt:1) Server platform with InfiniBand HCA (see Mellanox IBED
> Distributio
> n Release Notes for details)
> README.txt:2) Linux OS (see Mellanox IBED Distribution Release Notes for
> details
> )
> README.txt:  o   Firmware for Mellanox's switch and HCA products
> docs/IBED_Installation_Guide.txt:Mellanox IBED Distribution Installation
> Guide
> docs/IBED_Installation_Guide.txt: 2. Contents of the Mellanox IBED
> Distribution
> docs/IBED_Installation_Guide.txt:2. Contents of the Mellanox IBED
> Distribution
> docs/IBED_Installation_Guide.txt:  o   Firmware for Mellanox's switch
> and HCA pr
> oducts
> docs/IBED_Installation_Guide.txt:     "Mellanox IBED Release Notes".
>
> 2) When I run install.sh or build.sh and tell it to compile both MPIs, I
> get the same questions twice, which I assume one is for MVAPICH and one
> for Open MPI, but this needs to be clearer:
>
>   
[VS] You are right. I will add MPI name to the question.
> The following compiler(s) on your system can be used to build/install
> MPI:  gcc
>
> Do you wish to create/install an MPI RPM with gcc? [Y/n]:
>
> The following compiler(s) will be used to build the MPI RPM(s):  gcc
>
> The following compiler(s) on your system can be used to build/install
> MPI:  gcc
>
> Do you wish to create/install an MPI RPM with gcc? [Y/n]: 
>
> 3) It would be nice if install.sh asked me if I wanted to configure IP
> address, rather than forcing me to.
>
> The default IPoIB interface configuration is based on a LAN interface
> configura.
> You may change this default configuration in the following steps.
>
> Enter LAN interface to be used for setting ib0 interface [eth0]:
>
>   
[VS] Corresponding question will be added to install script.
> 4) I would like to see /etc/infiniband/ifcfg-ib0 be in
> /etc/sysconfig/network-scripts.
>
>   
[VS] Will be done for rc4, possibly not for all distributions.
> 5) I would like to see entries for ipoib and sdp in /etc/modprobe.conf.
>
>   
[VS] Will be done for rc4, possibly not for all distributions (SuSE 
10.0  has an issue with unloading modules).
> 6) It would be nice if install.sh offered to setup
> /etc/security/limits.conf.
>
>   
[VS] I will check what can be done.
> 7) If I run install.sh on one machine, then install the resulting RPMS
> on a different machine, I get slightly different sets of files installed
> on the two machines in /usr/local/ibed:
>
>   
[VS] You probably did not used IBED install.sh script to install another 
machine. The following files are copied by install.sh: BUILD_ID, 
LICENSE, README.txt, docs, ibed.conf, uninstall.sh
          Regarding the header files each one of them is a part of 
corresponding /devel/ package, e.g. common.h included in 
libibcommon-devel ...rpm. Please check if this RPM installed.
          Please update me if I am wrong.
> < ./BUILD_ID
> < ./LICENSE
> < ./README.txt
> 70,71d66
> < ./docs
> < ./docs/IBED_Installation_Guide.txt
> 74d68
> < ./ibed.conf
> 114a109
>   
>> ./include/infiniband/common.h
>>     
> 165a161
>   
>> ./include/infiniband/mad.h
>>     
> 178a175
>   
>> ./include/infiniband/umad.h
>>     
> 260a258
>   
>> ./lib64/libibcommon.so
>>     
> 263a262
>   
>> ./lib64/libibmad.so
>>     
> 266a266
>   
>> ./lib64/libibumad.so
>>     
> 1425d1424
> < ./uninstall.sh
>
>   
>> -----Original Message-----
>> From: openfabrics-ewg-bounces at openib.org 
>> [mailto:openfabrics-ewg-bounces at openib.org] On Behalf Of 
>> Vladimir Sokolovsky
>> Sent: Monday, April 10, 2006 9:55 AM
>> To: openfabrics-ewg at openib.org
>> Cc: openib-general
>> Subject: [openfabrics-ewg] IBED-1.0-rc3 is available
>>
>> Hi All,
>> We have prepared IBED 1.0 RC3.
>> Release location: 
>> *https://openib.org/svn/gen2/branches/1.0/ibed/releases*
>> File: IBED-1.0-rc3.tgz
>> md5sum: 8e143fd4b63646ebc9f5c9f73d18394b
>>
>> *_BUILD_ID:_*
>> IBED-1.0-rc3:
>> OpenIB:
>> openib_branch1.0-20060410-1551 (REV=6367)
>> Userspace SVN path: 
>> https://openib.org/svn/gen2/branches/1.0/src/userspace
>> IB Kernel modules SVN path: 
>> https://openib.org/svn/gen2/branches/1.0/ibed/tags/rc3/linux-kernel
>> MPI:
>> openmpi-1.0.2a12-1
>> mpi_osu-0.9.7-mlx2.1.0
>> mpitests-1.0-0
>>
>> *OSes:*
>>
>>     * RH EL4 up2: 2.6.9-22.ELsmp
>>     * RH EL4 up3: 2.6.9-34.ELsmp
>>     * Fedora C4: 2.6.11-1.1369_FC4
>>     * SLES10 beta 7: 2.6.16-rc5-git9-2-smp
>>     * SUSE 10 Pro: 2.6.13-15-smp
>>     * kernel.org: 2.6.16
>>
>> *Systems:*
>>
>>     * x86_64
>>     * x86
>>     * ia64
>>     * ppc64
>>
>>
>> *Main changes from RC2:*
>>
>>    1. Added support in Rh EL4 up3
>>    2. Added Open MPI package
>>    3. OSU MPI is now based on 0.97 release (was 0.95 in RC2)
>>    4. Added Pathscale (ipath) driver
>>    5. Added uDapl
>>    6. build based on the new method: Userlevel from openib branch 1.0
>>       and kernel from openib trunk. (will be from the git in RC4)
>>    7. Added ibutils package
>>    8. Bug fixes
>>
>> *Package limitations:*
>>
>>    1. iSER is working on SuSE SLES 10 Beta8 only
>>    2. MPI OSU and Open MPI compilation fails on PPC64
>>    3. uDAPL does not supported on RH EL4 (up2 and up3) since rdma_ucm
>>       module does not work on 2.6.9* kernels. If someone has 
>> a patch we
>>       will use it.
>>    4. ipath driver compilation fails on RH EL4 and FedoraC4.
>>
>> Please send me and Vlad any issue you encounter and testing results.
>>
>> Thanks
>> Tziporet & Vlad
>> _______________________________________________
>> openfabrics-ewg mailing list
>> openfabrics-ewg at openib.org
>> http://openib.org/mailman/listinfo/openfabrics-ewg
>>
>>     
> _______________________________________________
> openfabrics-ewg mailing list
> openfabrics-ewg at openib.org
> http://openib.org/mailman/listinfo/openfabrics-ewg
>
>   