<HTML dir=ltr><HEAD><TITLE>Re: [openfabrics-ewg] OFED-1.0-rc6 is available</TITLE>
<META http-equiv=Content-Type content="text/html; charset=unicode">
<META content="MSHTML 6.00.2900.2873" name=GENERATOR>
<STYLE>
<!--
font-face
{font-family:Tahoma;}
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman";}
a:link, span.MsoHyperlink
{color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{color:blue;
text-decoration:underline;}
p
{margin-right:0in;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman";}
span.EmailStyle18
{font-family:Arial;
color:navy;}
div.Section1
{page:Section1;}
-->
</STYLE>
</HEAD>
<BODY lang=EN-US vLink=blue link=blue>
<DIV id=idOWAReplyText57060 dir=ltr>
<DIV dir=ltr><FONT face=Arial color=#000000 size=2>I have also updated the bug with this work around info.</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>Thanks</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2>Karun</FONT></DIV></DIV>
<DIV dir=ltr><BR>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> Tziporet Koren [mailto:tziporet@mellanox.co.il]<BR><B>Sent:</B> Mon 6/12/2006 12:43 PM<BR><B>To:</B> Jeff Squyres (jsquyres); Sharma, Karun; Vladimir Sokolovsky<BR><B>Cc:</B> openfabrics-ewg@openib.org<BR><B>Subject:</B> RE: [openfabrics-ewg] OFED-1.0-rc6 is available<BR></FONT><BR></DIV>
<DIV>
<DIV class=Section1>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">I will add it to IPoIB RN</SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Tziporet</SPAN></FONT></P>
<P class=MsoNormal><FONT face=Arial color=navy size=2><SPAN style="FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial"></SPAN></FONT> </P>
<P class=MsoNormal style="MARGIN-LEFT: 0.5in"><FONT face=Tahoma size=2><SPAN style="FONT-SIZE: 10pt; FONT-FAMILY: Tahoma">-----Original Message-----<BR><B><SPAN style="FONT-WEIGHT: bold">From:</SPAN></B> openfabrics-ewg-bounces@openib.org [mailto:openfabrics-ewg-bounces@openib.org] <B><SPAN style="FONT-WEIGHT: bold">On Behalf Of </SPAN></B>Jeff Squyres (jsquyres)<BR><B><SPAN style="FONT-WEIGHT: bold">Sent:</SPAN></B> Monday, June 12, 2006 4:46 PM<BR><B><SPAN style="FONT-WEIGHT: bold">To:</SPAN></B> Sharma, Karun; Vladimir Sokolovsky<BR><B><SPAN style="FONT-WEIGHT: bold">Cc:</SPAN></B> openfabrics-ewg@openib.org<BR><B><SPAN style="FONT-WEIGHT: bold">Subject:</SPAN></B> Re: [openfabrics-ewg] OFED-1.0-rc6 is available</SPAN></FONT></P>
<P class=MsoNormal style="MARGIN-LEFT: 0.5in"><FONT face="Times New Roman" size=3><SPAN style="FONT-SIZE: 12pt"></SPAN></FONT> </P>
<P style="MARGIN-BOTTOM: 12pt; MARGIN-LEFT: 0.5in; MARGIN-RIGHT: 0in"><FONT face="Times New Roman" size=2><SPAN style="FONT-SIZE: 10pt">Has this been documented somewhere? If this is a known issue, is should at least be docunmented (perhaps in / near the list of supported distros...?).<BR><BR>Does openib itself fail with SELINUX=yes, or is it just an issue with parsing script output for this case?<BR><BR> -----Original Message-----<BR>From: Sharma, Karun [<A href="mailto:ksharma@silverstorm.com">mailto:ksharma@silverstorm.com</A>]<BR>Sent: Mon Jun 12 05:05:49 2006<BR>To: Vladimir Sokolovsky<BR>Cc: openfabrics-ewg@openib.org<BR>Subject: Re: [openfabrics-ewg] OFED-1.0-rc6 is available<BR><BR>Hi Vladimir:<BR><BR>Its working with this work around.<BR><BR>Thanks<BR>Karun<BR><BR><BR>________________________________<BR><BR>From: Vladimir Sokolovsky [<A href="mailto:vlad@mellanox.co.il">mailto:vlad@mellanox.co.il</A>]<BR>Sent: Mon 6/12/2006 3:08 AM<BR>To: Sharma, Karun<BR>Cc: Scott Weitzenkamp (sweitzen); openfabrics-ewg@openib.org<BR>Subject: Re: [openfabrics-ewg] OFED-1.0-rc6 is available<BR><BR><BR><BR>Hi Karun,<BR>Please try the following workaround:<BR><BR>Edit "/etc/selinux/config", set SELINUX=disabled<BR><BR>Regards,<BR>Vladimir<BR><BR>Sharma, Karun wrote:<BR>> I think this should get fixed as it is affecting 2 OSes (RHEL4 up2<BR>> and FC4), which are supported by OFED.<BR>> Any comments/suggestions?<BR>><BR>><BR>> ------------------------------------------------------------------------<BR>> *From:* Scott Weitzenkamp (sweitzen) [<A href="mailto:sweitzen@cisco.com">mailto:sweitzen@cisco.com</A>]<BR>> *Sent:* Mon 6/12/2006 12:18 AM<BR>> *To:* Sharma, Karun; Vladimir Sokolovsky<BR>> *Cc:* openfabrics-ewg@openib.org<BR>> *Subject:* RE: [openfabrics-ewg] OFED-1.0-rc6 is available<BR>><BR>> Reopen it if you feel it is worth fixing, but I think you will have<BR>> much better luck with RHEL4 U3 than U2.<BR>><BR>> Scott<BR>><BR>> ------------------------------------------------------------------------<BR>> *From:* Sharma, Karun [<A href="mailto:ksharma@silverstorm.com">mailto:ksharma@silverstorm.com</A>]<BR>> *Sent:* Sunday, June 11, 2006 9:16 PM<BR>> *To:* Scott Weitzenkamp (sweitzen); Vladimir Sokolovsky<BR>> *Cc:* openfabrics-ewg@openib.org<BR>> *Subject:* RE: [openfabrics-ewg] OFED-1.0-rc6 is available<BR>><BR>> Hi Scott:<BR>> <BR>> Yes you are right. I am hitting bug # 42 ( see below for log).<BR>> <BR>> Vlad:<BR>> Is there any plan to fix this bug? I observed that the bug is<BR>> closed with "Won't Fix" message. I observed same issue on FC4<BR>> servers also.<BR>> <BR>> Thanks<BR>> Karun<BR>> <BR>> ########################################################################<BR>> Jun 12 00:03:10 st45 kernel: SELinux: initialized (dev<BR>> infinibandeventfs, type i<BR>> nfinibandeventfs), not configured for labeling<BR>> Jun 12 00:03:10 st45 kernel: audit(1150084989.240:2): avc:<BR>> denied { mount } for pid=1929 comm="modprobe"<BR>> name="infinibandevent:" dev=infinibandeventfs ino=4747<BR>> scontext=user_u:system_r:initrc_t<BR>> tcontext=system_u:object_r:unlabeled_t tclass=filesystem<BR>> Jun 12 00:03:10 st45 kernel: user_verbs: couldn't mount<BR>> infinibandeventfs<BR>> Jun 12 00:03:10 st45 kernel: SELinux: initialized (dev rpc_pipefs,<BR>> type rpc_pipe<BR>> fs), uses genfs_contexts<BR>> #################################################################<BR>><BR>> ------------------------------------------------------------------------<BR>> *From:* Scott Weitzenkamp (sweitzen) [<A href="mailto:sweitzen@cisco.com">mailto:sweitzen@cisco.com</A>]<BR>> *Sent:* Fri 6/9/2006 11:32 AM<BR>> *To:* Sharma, Karun; Vladimir Sokolovsky<BR>> *Cc:* openfabrics-ewg@openib.org<BR>> *Subject:* RE: [openfabrics-ewg] OFED-1.0-rc6 is available<BR>><BR>> For RHEL4 U2, are there any messages on the console when openibd<BR>> is run at boot time? If so, you might be hitting bug 42<BR>> (<A href="http://openib.org/bugzilla/show_bug.cgi?id=42">http://openib.org/bugzilla/show_bug.cgi?id=42</A>).<BR>> <BR>> We had lots of problems on RHEL4 U2, so gave up and are only<BR>> testing on RHEL4 U3.<BR>> <BR>> Scott Weitzenkamp<BR>> SQA and Release Manager<BR>> Server Virtualization Business Unit<BR>> Cisco Systems<BR>> <BR>><BR>> ------------------------------------------------------------------------<BR>> *From:* openfabrics-ewg-bounces@openib.org<BR>> [<A href="mailto:openfabrics-ewg-bounces@openib.org">mailto:openfabrics-ewg-bounces@openib.org</A>] *On Behalf Of<BR>> *Sharma, Karun<BR>> *Sent:* Thursday, June 08, 2006 9:05 PM<BR>> *To:* Vladimir Sokolovsky<BR>> *Cc:* openfabrics-ewg@openib.org<BR>> *Subject:* RE: [openfabrics-ewg] OFED-1.0-rc6 is available<BR>><BR>> Hi Vlad:<BR>> <BR>> See below for the output. I performed following steps:<BR>> 1. After installing RC6 and configuring IB interfaces during<BR>> the install process, i rebooted the system.<BR>> <BR>> 2. Then I did ifconfig ib0. It doesn't show the ip address<BR>> configured during install.<BR>> <BR>> 3. After that I checked the status of openibd. It was running<BR>> fine and showing me ib0 and ib1 as active devices.<BR>> <BR>> 4. Then I restarted openibd. After this restart, I was able to<BR>> see the IP address of ib0 and ib1 interfaces.<BR>> <BR>> But after reboot we should see the IP addresses and should not<BR>> restart openibd everytime after reboot.<BR>> Now if I again reboot the system, I will lose the ip addresses<BR>> of IB interfaces. I am able to reproduce it.<BR>> <BR>> Thanks,<BR>> Karun<BR>> <BR>> <BR>> ######################################################################################<BR>> The system is going down for reboot NOW!<BR>> [st44 Thu Jun 08 23:46:44]# Last login: Thu Jun 8 23:46:37<BR>> 2006 from 192.168.0.62<BR>> [st44 Thu Jun 08 23:54:29]# ifconfig ib0<BR>> ib0 Link encap:UNSPEC HWaddr<BR>> 00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00<BR>> UP BROADCAST RUNNING MULTICAST MTU:2044 Metric:1<BR>> RX packets:0 errors:0 dropped:0 overruns:0 frame:0<BR>> TX packets:0 errors:0 dropped:2 overruns:0 carrier:0<BR>> collisions:0 txqueuelen:128<BR>> RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)<BR>> [st44 Thu Jun 08 23:54:35]# /etc/init.d/openibd status<BR>> HCA driver loaded<BR>> Configured devices:<BR>> ib0 ib1<BR>> Currently active devices:<BR>> ib0<BR>> ib1<BR>><BR>> [st44 Thu Jun 08 23:54:47]# /etc/init.d/openibd restart<BR>> Shutting down interface ib0: [<BR>> OK ]<BR>> Shutting down interface ib1: [<BR>> OK ]<BR>> Unloading HCA driver: [<BR>> OK ]<BR>> Loading HCA driver and Access Layer: [<BR>> OK ]<BR>> Setting up InfiniBand network interfaces:<BR>> Bringing up interface ib0: [<BR>> OK ]<BR>> Bringing up interface ib1: [<BR>> OK ]<BR>> Setting up service network . . . [<BR>> done ]<BR>> [st44 Thu Jun 08 23:55:08]# ifconfig ib0<BR>> ib0 Link encap:UNSPEC HWaddr<BR>> 00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00<BR>> inet addr:172.26.16.44 Bcast:172.26.16.255<BR>> Mask:255.255.240.0<BR>> UP BROADCAST RUNNING MULTICAST MTU:2044 Metric:1<BR>> RX packets:0 errors:0 dropped:0 overruns:0 frame:0<BR>> TX packets:0 errors:0 dropped:2 overruns:0 carrier:0<BR>> collisions:0 txqueuelen:128<BR>> RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)<BR>> [st44 Thu Jun 08 23:55:12]#<BR>> ####################################################################<BR>><BR>> ------------------------------------------------------------------------<BR>> *From:* Vladimir Sokolovsky [<A href="mailto:vlad@mellanox.co.il">mailto:vlad@mellanox.co.il</A>]<BR>> *Sent:* Thu 6/8/2006 9:48 AM<BR>> *To:* Sharma, Karun<BR>> *Cc:* Tziporet Koren; openfabrics-ewg@openib.org<BR>> *Subject:* Re: [openfabrics-ewg] OFED-1.0-rc6 is available<BR>><BR>> Hi Karun,<BR>> I can't reproduce this issue.<BR>> Please try '/etc/init.d/openibd restart' and send me the output.<BR>><BR>> Please check that ifcfg-ib0 located under<BR>> /etc/sysconfig/network on SuSE and<BR>> under /etc/sysconfig/network-scripts on RedHat/Fedora.<BR>> Thanks,<BR>><BR>> Regards,<BR>> Vladimir<BR>><BR>><BR>><BR>> Sharma, Karun wrote:<BR>> > Hi Tziporet:<BR>> ><BR>> > At the end of install script, we specify IP addresses for<BR>> ib0 and ib1<BR>> > interfaces. Then i reboot the system. After the system comes<BR>> back, i<BR>> > observed that ip address of ib0 interface (ifconfig ib0) is<BR>> missing.<BR>> > We need to configure again the ip address of ib0 and ib1<BR>> interfaces.<BR>> > Please let me know if this is a bug. Why do we need to<BR>> specify same ip<BR>> > address twice? I can see the IP address which i configure during<BR>> > install time in ifcfg-ib0 file.<BR>> ><BR>> > I have seen this behaviour on RHEL4 up2 and FC4 servers.<BR>> Below are<BR>> > some logs.<BR>> ><BR>> > Thanks<BR>> > Karun<BR>> ><BR>> > ################################################################<BR>> ><BR>> > [root@ss23 ~]# /etc/init.d/opensmd status<BR>> > opensm (pid 3216) is running...<BR>> > [root@ss23 ~]# cat /etc/sysconfig/network-scripts/ifcfg-ib0<BR>> > DEVICE=ib0<BR>> > BOOTPROTO=static<BR>> > IPADDR=172.20.51.223<BR>> > NETMASK=255.255.255.0<BR>> > NETWORK=172.20.0.0<BR>> > BROADCAST=172.20.51.255<BR>> > ONBOOT=yes<BR>> > [root@ss23 ~]# ifconfig ib0<BR>> > ib0 Link encap:InfiniBand HWaddr<BR>> > 00:00:00:14:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00<BR>> > inet6 addr: fe80::206:6a00:a000:537/64 Scope:Link<BR>> > UP BROADCAST RUNNING MULTICAST MTU:2044 Metric:1<BR>> > RX packets:0 errors:0 dropped:0 overruns:0 frame:0<BR>> > TX packets:0 errors:0 dropped:0 overruns:0 carrier:0<BR>> > collisions:0 txqueuelen:128<BR>> > RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)<BR>> > [root@ss23 ~]#<BR>> ><BR>> ##############################################################################<BR>><BR><BR><BR></SPAN></FONT></P></DIV></DIV></BODY></HTML>