<HTML dir=ltr><HEAD><TITLE>Re: [openfabrics-ewg] OFED-1.0-rc6 is available</TITLE>
<META http-equiv=Content-Type content="text/html; charset=unicode">
<META content="MSHTML 6.00.2900.2873" name=GENERATOR></HEAD>
<BODY>
<DIV id=idOWAReplyText37168 dir=ltr>
<DIV dir=ltr><FONT face=Arial color=#000000 size=2>I think this should get fixed as it is affecting 2 OSes (RHEL4 up2 and FC4), which are supported by OFED. </FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2>Any comments/suggestions?</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV></DIV>
<DIV dir=ltr><BR>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> Scott Weitzenkamp (sweitzen) [mailto:sweitzen@cisco.com]<BR><B>Sent:</B> Mon 6/12/2006 12:18 AM<BR><B>To:</B> Sharma, Karun; Vladimir Sokolovsky<BR><B>Cc:</B> openfabrics-ewg@openib.org<BR><B>Subject:</B> RE: [openfabrics-ewg] OFED-1.0-rc6 is available<BR></FONT><BR></DIV>
<DIV dir=ltr>
<DIV dir=ltr align=left><SPAN class=473221704-12062006><FONT face=Arial color=#0000ff size=2>Reopen it if you feel it is worth fixing, but I think you will have much better luck with RHEL4 U3 than U2.</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=473221704-12062006><FONT face=Arial color=#0000ff size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=473221704-12062006><FONT face=Arial color=#0000ff size=2>Scott</FONT></SPAN></DIV><BR>
<BLOCKQUOTE dir=ltr style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #0000ff 2px solid; MARGIN-RIGHT: 0px">
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> Sharma, Karun [mailto:ksharma@silverstorm.com] <BR><B>Sent:</B> Sunday, June 11, 2006 9:16 PM<BR><B>To:</B> Scott Weitzenkamp (sweitzen); Vladimir Sokolovsky<BR><B>Cc:</B> openfabrics-ewg@openib.org<BR><B>Subject:</B> RE: [openfabrics-ewg] OFED-1.0-rc6 is available<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV id=idOWAReplyText21130 dir=ltr>
<DIV dir=ltr><FONT face=Arial color=#000000 size=2>Hi Scott:</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>Yes you are right. I am hitting bug # 42 ( see below for log). </FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>Vlad:</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2>Is there any plan to fix this bug? I observed that the bug is closed with "Won't Fix" message. I observed same issue on FC4 servers also. </FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>Thanks</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2>Karun</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>########################################################################</FONT></DIV>
<DIV dir=ltr>Jun 12 00:03:10 st45 kernel: SELinux: initialized (dev infinibandeventfs, type i<BR>nfinibandeventfs), not configured for labeling<BR>Jun 12 00:03:10 st45 kernel: audit(1150084989.240:2): avc: denied { mount } for pid=1929 comm="modprobe" name="infinibandevent:" dev=infinibandeventfs ino=4747 scontext=user_u:system_r:initrc_t tcontext=system_u:object_r:unlabeled_t tclass=filesystem<BR>Jun 12 00:03:10 st45 kernel: user_verbs: couldn't mount infinibandeventfs<BR>Jun 12 00:03:10 st45 kernel: SELinux: initialized (dev rpc_pipefs, type rpc_pipe<BR>fs), uses genfs_contexts<BR>#################################################################</DIV></DIV>
<DIV dir=ltr><BR>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> Scott Weitzenkamp (sweitzen) [mailto:sweitzen@cisco.com]<BR><B>Sent:</B> Fri 6/9/2006 11:32 AM<BR><B>To:</B> Sharma, Karun; Vladimir Sokolovsky<BR><B>Cc:</B> openfabrics-ewg@openib.org<BR><B>Subject:</B> RE: [openfabrics-ewg] OFED-1.0-rc6 is available<BR></FONT><BR></DIV>
<DIV dir=ltr>
<DIV dir=ltr align=left><SPAN class=199422915-09062006><FONT face=Arial color=#0000ff size=2>For RHEL4 U2, are there any messages on the console when openibd is run at boot time? If so, you might be hitting bug 42 (<A href="http://openib.org/bugzilla/show_bug.cgi?id=42">http://openib.org/bugzilla/show_bug.cgi?id=42</A>).</FONT></SPAN></DIV>
<DIV dir=ltr align=left><SPAN class=199422915-09062006><FONT face=Arial color=#0000ff size=2></FONT></SPAN> </DIV>
<DIV dir=ltr align=left><SPAN class=199422915-09062006><FONT face=Arial color=#0000ff size=2>We had lots of problems on RHEL4 U2, so gave up and are only testing on RHEL4 U3.</FONT></SPAN></DIV>
<DIV> </DIV>
<DIV align=left><FONT face=Arial color=#0000ff size=2>Scott Weitzenkamp</FONT></DIV>
<DIV align=left><FONT face=Arial color=#0000ff size=2>SQA and Release Manager</FONT></DIV>
<DIV align=left><FONT face=Arial color=#0000ff size=2>Server Virtualization Business Unit</FONT></DIV>
<DIV align=left><FONT face=Arial color=#0000ff size=2>Cisco Systems</FONT></DIV>
<DIV> </DIV><BR>
<BLOCKQUOTE dir=ltr style="PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #0000ff 2px solid; MARGIN-RIGHT: 0px">
<DIV class=OutlookMessageHeader lang=en-us dir=ltr align=left>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> openfabrics-ewg-bounces@openib.org [mailto:openfabrics-ewg-bounces@openib.org] <B>On Behalf Of </B>Sharma, Karun<BR><B>Sent:</B> Thursday, June 08, 2006 9:05 PM<BR><B>To:</B> Vladimir Sokolovsky<BR><B>Cc:</B> openfabrics-ewg@openib.org<BR><B>Subject:</B> RE: [openfabrics-ewg] OFED-1.0-rc6 is available<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV id=idOWAReplyText36383 dir=ltr>
<DIV dir=ltr><FONT face=Arial color=#000000 size=2>Hi Vlad:</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>See below for the output. I performed following steps:</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2>1. After installing RC6 and configuring IB interfaces during the install process, i rebooted the system.</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>2. Then I did ifconfig ib0. It doesn't show the ip address configured during install.</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>3. After that I checked the status of openibd. It was running fine and showing me ib0 and ib1 as active devices.</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>4. Then I restarted openibd. After this restart, I was able to see the IP address of ib0 and ib1 interfaces. </FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>But after reboot we should see the IP addresses and should not restart openibd everytime after reboot.</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2>Now if I again reboot the system, I will lose the ip addresses of IB interfaces. I am able to reproduce it.</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>Thanks,</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2>Karun</FONT></DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2></FONT> </DIV>
<DIV dir=ltr><FONT face=Arial size=2>######################################################################################</FONT></DIV>
<DIV dir=ltr>The system is going down for reboot NOW!<BR>[st44 Thu Jun 08 23:46:44]# Last login: Thu Jun 8 23:46:37 2006 from 192.168.0.62<BR>[st44 Thu Jun 08 23:54:29]# ifconfig ib0<BR>ib0 Link encap:UNSPEC HWaddr 00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00 <BR> UP BROADCAST RUNNING MULTICAST MTU:2044 Metric:1<BR> RX packets:0 errors:0 dropped:0 overruns:0 frame:0<BR> TX packets:0 errors:0 dropped:2 overruns:0 carrier:0<BR> collisions:0 txqueuelen:128 <BR> RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)</DIV>
<DIV dir=ltr>[st44 Thu Jun 08 23:54:35]# /etc/init.d/openibd status</DIV>
<DIV dir=ltr> HCA driver loaded</DIV>
<DIV dir=ltr>Configured devices:<BR>ib0 ib1</DIV>
<DIV dir=ltr>Currently active devices:<BR>ib0<BR>ib1</DIV>
<DIV dir=ltr><BR>[st44 Thu Jun 08 23:54:47]# /etc/init.d/openibd restart<BR>Shutting down interface ib0: [ OK ]<BR>Shutting down interface ib1: [ OK ]<BR>Unloading HCA driver: [ OK ]<BR>Loading HCA driver and Access Layer: [ OK ]<BR>Setting up InfiniBand network interfaces:<BR>Bringing up interface ib0: [ OK ]<BR>Bringing up interface ib1: [ OK ]<BR>Setting up service network . . . [ done ]<BR>[st44 Thu Jun 08 23:55:08]# ifconfig ib0<BR>ib0 Link encap:UNSPEC HWaddr 00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00 <BR> inet addr:172.26.16.44 Bcast:172.26.16.255 Mask:255.255.240.0<BR> UP BROADCAST RUNNING MULTICAST MTU:2044 Metric:1<BR> RX packets:0 errors:0 dropped:0 overruns:0 frame:0<BR> TX packets:0 errors:0 dropped:2 overruns:0 carrier:0<BR> collisions:0 txqueuelen:128 <BR> RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)</DIV>
<DIV dir=ltr>[st44 Thu Jun 08 23:55:12]# <BR>####################################################################</DIV></DIV>
<DIV dir=ltr><BR>
<HR tabIndex=-1>
<FONT face=Tahoma size=2><B>From:</B> Vladimir Sokolovsky [mailto:vlad@mellanox.co.il]<BR><B>Sent:</B> Thu 6/8/2006 9:48 AM<BR><B>To:</B> Sharma, Karun<BR><B>Cc:</B> Tziporet Koren; openfabrics-ewg@openib.org<BR><B>Subject:</B> Re: [openfabrics-ewg] OFED-1.0-rc6 is available<BR></FONT><BR></DIV>
<DIV>
<P><FONT size=2>Hi Karun,<BR>I can't reproduce this issue.<BR>Please try '/etc/init.d/openibd restart' and send me the output.<BR><BR>Please check that ifcfg-ib0 located under /etc/sysconfig/network on SuSE and<BR>under /etc/sysconfig/network-scripts on RedHat/Fedora.<BR>Thanks,<BR><BR>Regards,<BR>Vladimir<BR><BR><BR><BR>Sharma, Karun wrote:<BR>> Hi Tziporet:<BR>> <BR>> At the end of install script, we specify IP addresses for ib0 and ib1<BR>> interfaces. Then i reboot the system. After the system comes back, i<BR>> observed that ip address of ib0 interface (ifconfig ib0) is missing.<BR>> We need to configure again the ip address of ib0 and ib1 interfaces.<BR>> Please let me know if this is a bug. Why do we need to specify same ip<BR>> address twice? I can see the IP address which i configure during<BR>> install time in ifcfg-ib0 file.<BR>> <BR>> I have seen this behaviour on RHEL4 up2 and FC4 servers. Below are<BR>> some logs.<BR>> <BR>> Thanks<BR>> Karun<BR>> <BR>> ################################################################<BR>> <BR>> [root@ss23 ~]# /etc/init.d/opensmd status<BR>> opensm (pid 3216) is running...<BR>> [root@ss23 ~]# cat /etc/sysconfig/network-scripts/ifcfg-ib0<BR>> DEVICE=ib0<BR>> BOOTPROTO=static<BR>> IPADDR=172.20.51.223<BR>> NETMASK=255.255.255.0<BR>> NETWORK=172.20.0.0<BR>> BROADCAST=172.20.51.255<BR>> ONBOOT=yes<BR>> [root@ss23 ~]# ifconfig ib0<BR>> ib0 Link encap:InfiniBand HWaddr<BR>> 00:00:00:14:FE:80:00:00:00:00:00:00:00:00:00:00:00:00:00:00<BR>> inet6 addr: fe80::206:6a00:a000:537/64 Scope:Link<BR>> UP BROADCAST RUNNING MULTICAST MTU:2044 Metric:1<BR>> RX packets:0 errors:0 dropped:0 overruns:0 frame:0<BR>> TX packets:0 errors:0 dropped:0 overruns:0 carrier:0<BR>> collisions:0 txqueuelen:128<BR>> RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)<BR>> [root@ss23 ~]#<BR>> ##############################################################################<BR></FONT></P></DIV></BLOCKQUOTE></DIV></BLOCKQUOTE></DIV></BODY></HTML>