<HTML dir=ltr><HEAD><TITLE>RE: [ewg] OFED 1.2 RC2 on rhel4u4 x86_64</TITLE>
<META http-equiv=Content-Type content="text/html; charset=unicode">
<META content="MSHTML 6.00.6000.16397" name=GENERATOR></HEAD>
<BODY>
<DIV id=idOWAReplyText66721 dir=ltr>
<DIV dir=ltr><FONT face=Arial color=#000000 size=2>So I don't understand it then... Why are my RPMs only containing one of the two versions. I'm running on ES and not AS but that shouldn't really matter...</FONT></DIV>
<DIV dir=ltr><FONT face=Arial color=#000000 size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>This output that you list :</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>[root@sfw1 redhat-release-4AS-5.5]# rpm -qpl libibverbs-1.1-0.x86_64.rpm<BR>/etc/ld.so.conf.d/ofed.conf<BR>/usr/lib/libibverbs.so.1<BR>/usr/lib/libibverbs.so.1.0.0<BR>/usr/lib64/libibverbs.so.1<BR>/usr/lib64/libibverbs.so.1.0.0<BR></FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2>Is exactly what I would have expected as well, but my RPM says :</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>[root@pe1850-1 redhat-release-4ES-5.5]# pwd<BR>/root/OFED-1.2-rc2/RPMS/redhat-release-4ES-5.5<BR>[root@pe1850-1 redhat-release-4ES-5.5]# rpm -qpl libibverbs-1.1-0.x86_64.rpm<BR>/etc/ld.so.conf.d/ofed.conf<BR>/usr/lib/libibverbs.so.1<BR>/usr/lib/libibverbs.so.1.0.0<BR></FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2>I'm lookin through the build log (/tmp/OFED.build.xxx.log) and both versions get compiled, but it looks like the 32bit libraries (which gets compiled last) overwrites the 64bit libraries in the "make install" section because both ends up in /usr/lib :</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>(64bit section of the build) :</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>/usr/bin/install -c src/.libs/libibverbs.so.1.0.0 /var/tmp/OFED/usr/lib/libibverbs.so.1.0.0<BR>(cd /var/tmp/OFED/usr/lib && { ln -s -f libibverbs.so.1.0.0 libibverbs.so.1 || { rm -f libibverbs.so.1 && ln -s libibverbs.so.1.0.0 libibverbs.so.1; }; })<BR>(cd /var/tmp/OFED/usr/lib && { ln -s -f libibverbs.so.1.0.0 libibverbs.so || { rm -f libibverbs.so && ln -s libibverbs.so.1.0.0 libibverbs.so; }; })<BR></FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>(32bit section of the build) :</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2>/usr/bin/install -c src/.libs/libibverbs.so.1.0.0 /var/tmp/OFED/usr/lib/libibverbs.so.1.0.0<BR>(cd /var/tmp/OFED/usr/lib && { ln -s -f libibverbs.so.1.0.0 libibverbs.so.1 || { rm -f libibverbs.so.1 && ln -s libibverbs.so.1.0.0 libibverbs.so.1; }; })<BR>(cd /var/tmp/OFED/usr/lib && { ln -s -f libibverbs.so.1.0.0 libibverbs.so || { rm -f libibverbs.so && ln -s libibverbs.so.1.0.0 libibverbs.so; }; })<BR></FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>So the question is, why is the 64bit section ending up in <buildpath>/usr/lib in the first place ???</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>I do see this though :</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>/bin/rm -f /var/tmp/OFEDRPM/BUILD/ofa_user-1.2/configure.cache<BR>cd /var/tmp/OFEDRPM/BUILD/ofa_user-1.2/src/userspace/libibverbs<BR>Running: env ac_cv_lib_ibverbs_ibv_get_device_list=yes ac_cv_header_infiniband_driver_h=yes ac_cv_func_ibv_read_sysfs_file=yes ac_cv_func_ibv_dontfork_range=<BR>yes ac_cv_func_ibv_dofork_range=yes ac_cv_func_ibv_register_driver=yes HAVE_IBV_DEVICE_LIBRARY_EXTENSION_TRUE=yes ./configure --cache-file=/var/tmp/OFEDRPM/<BR>BUILD/ofa_user-1.2/configure.cache --disable-libcheck --prefix /usr --libdir /usr/lib --mandir=/usr/man --sysconfdir=/usr/etc CPPFLAGS="-I../libibverbs/include"<BR></FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>--libdir /usr/lib ??? shouldn't that be --libdir /usr/lib64 for the 64bit section ?</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>Cheers,</FONT></DIV></DIV>
<DIV id=idSignature10859 dir=ltr><PRE>Steffen Persvold
Technical Director Americas
tel. 508-281-7100 x401
fax. 508-281-7171
http://www.scali.com/
Scaling the Linux datacenter
</PRE></DIV>
<DIV dir=ltr><BR>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> Chieng Etta [mailto:etta@systemfabricworks.com]<BR><B>Sent:</B> Thu 5/3/2007 3:26 PM<BR><B>To:</B> Steffen Persvold; vlad@dev.mellanox.co.il<BR><B>Cc:</B> openfabrics-ewg@openib.org; openib-general@openib.org<BR><B>Subject:</B> RE: [ewg] OFED 1.2 RC2 on rhel4u4 x86_64<BR></FONT><BR></DIV>
<DIV>
<P><FONT size=2>Hi Steffen,<BR><BR>After removing all the OFED packages by using ./uninstall.sh, I tried<BR>./build.sh to build the RPMs then installed libibverbs-1.1-0.x86_64.rpm onto<BR>system. "libibverbs.so.1.0.0" was installed under the right directories<BR>(/usr/lib and /usr/lib64). Please see the output below. <BR>Thanks,<BR>Etta<BR><BR>[root@sfw1 etc]# cat /etc/*release<BR>Red Hat Enterprise Linux AS release 4 (Nahant Update 4)<BR>[root@sfw1 etc]# uname -a<BR>Linux sfw1.sfw.int 2.6.9-42.ELsmp #1 SMP Wed Jul 12 23:32:02 EDT 2006 x86_64<BR>x86_64 x86_64 GNU/Linux<BR><BR>[root@sfw1 lib64]# pwd<BR>/usr/lib64<BR>[root@sfw1 lib64]# ll libibverbs*<BR>ls: libibverbs*: No such file or directory<BR><BR>[root@sfw1 lib64]# rpm -aq |grep libibverbs<BR><BR>[root@sfw1 lib64]# cd -<BR>/root/images/OFED-1.2-rc2/RPMS/redhat-release-4AS-5.5<BR>[root@sfw1 redhat-release-4AS-5.5]# rpm -qpl libibverbs-1.1-0.x86_64.rpm<BR>/etc/ld.so.conf.d/ofed.conf<BR>/usr/lib/libibverbs.so.1<BR>/usr/lib/libibverbs.so.1.0.0<BR>/usr/lib64/libibverbs.so.1<BR>/usr/lib64/libibverbs.so.1.0.0<BR><BR>[root@sfw1 redhat-release-4AS-5.5]# rpm -ivh libibverbs-1.1-0.x86_64.rpm<BR>Preparing... ########################################### [100%]<BR> 1:libibverbs ########################################### [100%]<BR><BR>[root@sfw1 redhat-release-4AS-5.5]# rpm -qp --qf "%{arch}\n"<BR>libibverbs-1.1-0.x86_64.rpm<BR>x86_64<BR><BR>[root@sfw1 redhat-release-4AS-5.5]# cd -<BR>/usr/lib64<BR>[root@sfw1 lib64]# rpm -aq |grep libibverbs<BR>libibverbs-1.1-0<BR><BR>[root@sfw1 lib64]# ll libibverbs*<BR>lrwxrwxrwx 1 root root 19 May 3 13:50 libibverbs.so.1 -><BR>libibverbs.so.1.0.0<BR>-rwxr-xr-x 1 root root 200993 May 3 13:18 libibverbs.so.1.0.0<BR><BR>[root@sfw1 lib64]# file libibverbs.so.1.0.0<BR>libibverbs.so.1.0.0: ELF 64-bit LSB shared object, AMD x86-64, version 1<BR>(SYSV), not stripped<BR><BR>[root@sfw1 lib]# cd /usr/lib<BR>[root@sfw1 lib]# file libibverbs.so.1.0.0<BR>libibverbs.so.1.0.0: ELF 32-bit LSB shared object, Intel 80386, version 1<BR>(SYSV), not stripped<BR><BR>[root@sfw1 etc]# cat /etc/ld.so.conf<BR>include ld.so.conf.d/*.conf<BR>/usr/ofed/lib64<BR><BR>[root@sfw1 etc]# cat /etc/ld.so.conf.d/ofed.conf<BR>/usr/lib64<BR>/usr/lib<BR> <BR><BR>-----Original Message-----<BR>From: ewg-bounces@lists.openfabrics.org<BR>[<A href="mailto:ewg-bounces@lists.openfabrics.org">mailto:ewg-bounces@lists.openfabrics.org</A>] On Behalf Of Steffen Persvold<BR>Sent: Thursday, May 03, 2007 10:26 AM<BR>To: vlad@dev.mellanox.co.il<BR>Cc: openfabrics-ewg@openib.org; openib-general@openib.org<BR>Subject: RE: [ewg] OFED 1.2 RC2 on rhel4u4 x86_64<BR><BR>Vladimir,<BR><BR>Nope. Still the same issue. The RPMs will only contain one set of<BR>libraries and it is always in /usr/lib (if I set the build_32bit=0<BR>option I get the 64bit libraries but in the wrong directory).<BR><BR>Seriously, am I the only one seeing this ? I would think rhel4 u4 was a<BR>very normal test platform ?<BR><BR>Cheers,<BR><BR>Steffen Persvold<BR>Technical Director Americas<BR>tel. 508-281-7100 x401<BR>fax. 508-281-7171<BR><BR><A href="http://www.scali.com/">http://www.scali.com/</A><BR>Scaling the Linux datacenter<BR><BR><BR>> -----Original Message-----<BR>> From: Vladimir Sokolovsky [<A href="mailto:vlad@dev.mellanox.co.il">mailto:vlad@dev.mellanox.co.il</A>]<BR>> Sent: Thursday, May 03, 2007 9:07 AM<BR>> To: Steffen Persvold<BR>> Cc: openfabrics-ewg@openib.org; openib-general@openib.org<BR>> Subject: RE: [ewg] OFED 1.2 RC2 on rhel4u4 x86_64<BR>><BR>> Please see if this happens in OFED-1.2-20070503-0600.<BR>> But first uninstall the previous OFED version with ofed_uninstall.sh<BR>> command.<BR>><BR>> Thanks,<BR>><BR>> Regards,<BR>> Vladimir<BR>><BR>> On Wed, 2007-05-02 at 11:30 -0400, Steffen Persvold wrote:<BR>> > Hmm,<BR>> ><BR>> > so I tried something. I put :<BR>> ><BR>> > build_32bit=0<BR>> ><BR>> > into my ofed.conf file and rebuilt (build.sh -c ofed.conf). This<BR>time<BR>> > it built 64bit libraries, but it puts them in the wrong directory :<BR>> ><BR>> > # rpm -qpl ../libibverbs-1.1-0.x86_64.rpm<BR>> > /etc/ld.so.conf.d/ofed.conf<BR>> > /usr/lib/libibverbs.so.1<BR>> > /usr/lib/libibverbs.so.1.0.0<BR>> ><BR>> > # file /usr/lib/libibverbs.so.1.0.0<BR>> > /usr/lib/libibverbs.so.1.0.0: ELF 64-bit LSB shared object, AMD<BR>> > x86-64, version 1 (SYSV), not stripped<BR>> ><BR>> > So what's up ??<BR>> ><BR>> > Cheers,<BR>> > Steffen Persvold<BR>> > Technical Director Americas<BR>> > tel. 508-281-7100 x401<BR>> > fax. 508-281-7171<BR>> ><BR>> > <A href="http://www.scali.com/">http://www.scali.com/</A><BR>> > Scaling the Linux datacenter<BR>> ><BR>> ><BR>> ><BR>______________________________________________________________________<BR>> > From: Steffen Persvold<BR>> > Sent: Wed 5/2/2007 10:30 AM<BR>> > To: Steffen Persvold; Vladimir Sokolovsky<BR>> > Cc: openfabrics-ewg@openib.org; openib-general@openib.org<BR>> > Subject: RE: [ewg] OFED 1.2 RC2 on rhel4u4 x86_64<BR>> ><BR>> ><BR>> > Also,<BR>> ><BR>> > If I look at the /etc/ld.so.conf/ofed.conf file I have :<BR>> ><BR>> > # cat ofed.conf<BR>> > /usr/lib<BR>> > /usr/lib<BR>> ><BR>> ><BR>> > which seems kinda weird ? :)<BR>> ><BR>> > Cheers,<BR>> ><BR>> > Steffen Persvold<BR>> > Technical Director Americas<BR>> > tel. 508-281-7100 x401<BR>> > fax. 508-281-7171<BR>> ><BR>> > <A href="http://www.scali.com/">http://www.scali.com/</A><BR>> > Scaling the Linux datacenter<BR>> ><BR>> ><BR>> ><BR>______________________________________________________________________<BR>> > From: ewg-bounces@lists.openfabrics.org on behalf of Steffen<BR>Persvold<BR>> > Sent: Wed 5/2/2007 10:20 AM<BR>> > To: Vladimir Sokolovsky<BR>> > Cc: openfabrics-ewg@openib.org; openib-general@openib.org<BR>> > Subject: RE: [ewg] OFED 1.2 RC2 on rhel4u4 x86_64<BR>> ><BR>> ><BR>> > Nope :<BR>> ><BR>> ><BR>> > [redhat-release-4ES-5.5]# rpm -qpl libibverbs-1.1-0.x86_64.rpm<BR>> > /etc/ld.so.conf.d/ofed.conf<BR>> > /usr/lib/libibverbs.so.1<BR>> > /usr/lib/libibverbs.so.1.0.0<BR>> > [redhat-release-4ES-5.5]#<BR>> ><BR>> > So the RPM got built, but without 64bit libraries. Now if it was the<BR>> > other way around (i.e no 32bit libraries) I could have understood it<BR>> > (as 32bit is an option on x86_64), but not having the native 64bit<BR>> > libraries is not so easy to understand :)<BR>> ><BR>> > cheers,<BR>> > Steffen Persvold<BR>> > Technical Director Americas<BR>> > tel. 508-281-7100 x401<BR>> > fax. 508-281-7171<BR>> ><BR>> > <A href="http://www.scali.com/">http://www.scali.com/</A><BR>> > Scaling the Linux datacenter<BR>> ><BR>> ><BR>> ><BR>______________________________________________________________________<BR>> > From: ewg-bounces@lists.openfabrics.org on behalf of Vladimir<BR>> > Sokolovsky<BR>> > Sent: Wed 5/2/2007 10:05 AM<BR>> > To: Steffen Persvold<BR>> > Cc: openfabrics-ewg@openib.org; openib-general@openib.org<BR>> > Subject: Re: [ewg] OFED 1.2 RC2 on rhel4u4 x86_64<BR>> ><BR>> ><BR>> > Don't you have /usr/lib64/libibverbs.so.1.0.0?<BR>> ><BR>> > Regards,<BR>> > Vladimir<BR>> ><BR>> > On Wed, 2007-05-02 at 10:00 -0400, Steffen Persvold wrote:<BR>> > > Folks,<BR>> > ><BR>> > > I used the build.sh script to build the above mentioned packages<BR>on<BR>> > > rhel4u4 x86_64, but for some reason it only compiles 32bit<BR>libraries<BR>> > > (even if the packages are named x86_64) :<BR>> > ><BR>> > > # rpm -qp --qf "%{arch}\n" libibverbs-1.1-0.x86_64.rpm<BR>> > > x86_64<BR>> > ><BR>> > > (after installing it) :<BR>> > ><BR>> > > # file /usr/lib/libibverbs.so.1.0.0<BR>> > > /usr/lib/libibverbs.so.1.0.0: ELF 32-bit LSB shared object, Intel<BR>> > > 80386, version 1 (SYSV), not stripped<BR>> > ><BR>> > > What did I do wrong ??<BR>> > ><BR>> > > Cheers,<BR>> > > Steffen Persvold<BR>> > > Technical Director Americas<BR>> > > tel. 508-281-7100 x401<BR>> > > fax. 508-281-7171<BR>> > ><BR>> > > <A href="http://www.scali.com/">http://www.scali.com/</A><BR>> > > Scaling the Linux datacenter<BR>> > > _______________________________________________<BR>> > > ewg mailing list<BR>> > > ewg@lists.openfabrics.org<BR>> > > <A href="http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg">http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg</A><BR>> ><BR>> > _______________________________________________<BR>> > ewg mailing list<BR>> > ewg@lists.openfabrics.org<BR>> > <A href="http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg">http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg</A><BR>> ><BR>> ><BR>> ><BR><BR>_______________________________________________<BR>ewg mailing list<BR>ewg@lists.openfabrics.org<BR><A href="http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg">http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg</A><BR><BR></FONT></P></DIV></BODY></HTML>