<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=US-ASCII">
<META NAME="Generator" CONTENT="MS Exchange Server version 5.5.2654.45">
<TITLE>RE: [openib-general] IPoIB still not working</TITLE>
</HEAD>
<BODY>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">Hi Woody,</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">ERR 1B11</FONT><FONT COLOR="#0000FF" FACE="Palatino Linotype"> means</FONT><FONT COLOR="#0000FF" FACE="Palatino Linotype"> as it says:</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">The expected component mask for the join is not</FONT> <FONT COLOR="#0000FF" FACE="Palatino Linotype">sufficient</FONT><FONT COLOR="#0000FF" FACE="Palatino Linotype">.</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">Quoting from</FONT> <FONT COLOR="#0000FF" FACE="Palatino Linotype">your mail:</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">>></FONT> <FONT COLOR="#0000FF" FACE="Palatino Linotype">osm_mcmr_rcv_join_mgrp: ERR 1B11:</FONT><FONT COLOR="#0000FF" FACE="Palatino Linotype"></FONT> <FONT COLOR="#0000FF" FACE="Palatino Linotype">method = SubnAdmSet,scope_state = 0x1,</FONT> </P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">>></FONT> <FONT COLOR="#0000FF" FACE="Palatino Linotype">component mask =0x0000000000010083, expected comp mask = 0x00000000000130c7.</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">Seems the component mask being sent is missing bits:</FONT><FONT COLOR="#0000FF" FACE="Palatino Linotype"> 12,13 (starting from 0).</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">These are the</FONT> <FONT COLOR="#0000FF" FACE="Palatino Linotype">2^12 = SL and 2^13 = FlowLabel.</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">Please see the</FONT> <FONT COLOR="#0000FF" FACE="Palatino Linotype">following spec quote:</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">o15-0.2.2: If SA supports UD multicast, then SA shall create a multicast</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">group if it receives a SubnAdmSet() method for a MCMemberRecord, with</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">the MGID set to 0 and the MCMemberRecord:JoinState.FullMember bit</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">set to 1.</FONT><B><U></U></B><B><U> <FONT COLOR="#0000FF" FACE="Palatino Linotype">The required components in the MCMemberRecord for the group</FONT></U></B></P>
<P ALIGN=LEFT><B><U><FONT COLOR="#0000FF" FACE="Palatino Linotype">to be created are P_Key, Q_Key, SL, FlowLabel, TClass, JoinState and</FONT></U></B></P>
<P ALIGN=LEFT><B><U><FONT COLOR="#0000FF" FACE="Palatino Linotype">PortGID</FONT></U></B><FONT COLOR="#0000FF" FACE="Palatino Linotype"> (see o15-0.1.3:) with the corresponding bits in the Component-</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">Mask set. All other components may be wildcarded. This results in an implicit</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">join for the port specified by PortGID.</FONT></P>
<P ALIGN=LEFT><A NAME="_MailAutoSig"></A></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">In osm_sa-mcmember_record.h you can find:</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">#define REQUIRED_MC_CREATE_COMP_MASK </FONT> <FONT COLOR="#0000FF" FACE="Palatino Linotype">|\</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">(IB_MCR_COMPMASK_MGID | \</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">IB_MCR_COMPMASK_PORT_GID | \ </FONT> </P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">IB_MCR_COMPMASK_JOIN_STATE | \ </FONT> </P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">IB_MCR_COMPMASK_QKEY | \ </FONT> </P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">IB_MCR_COMPMASK_TCLASS | \</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">IB_MCR_COMPMASK_PKEY | \</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">I</FONT><FONT COLOR="#0000FF" FACE="Palatino Linotype">B_MCR_COMPMASK_FLOW | \</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">I</FONT><FONT COLOR="#0000FF" FACE="Palatino Linotype">B_MCR_COMPMASK_SL)</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">Eitan Zahavi</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">Design Technology Director</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">Mellanox Technologies LTD</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">Tel:+972-4-9097208</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">Fax:+972-4-9593245</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">P.O. Box 586 Yokneam 20692 ISRAEL</FONT></P>
<P ALIGN=LEFT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">-----Original Message-----<BR>
From: Woodruff, Robert J [<A HREF="mailto:robert.j.woodruff@intel.com">mailto:robert.j.woodruff@intel.com</A>]<BR>
Sent: Thursday, December 09, 2004 1:36 AM<BR>
To: Eitan Zahavi; Roland Dreier<BR>
Cc: openib-general@openib.org<BR>
Subject: RE: [openib-general] IPoIB still not working</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">I found the problem with parsing of ScopeState. It appears that there</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">was a bug</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">in ib_types.h in the sourceforge code base. This was already fixed in</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">the latest Mellanox code base. However, with that fixed, I still get the</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">following</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">error from opensm when ipoib tries to join the multicast group. </FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">This is the dump from the latest mellanox opensm. </FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">[1102546997:000053256][18007] -> osm_mcmr_rcv_join_mgrp: [</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">[1102546997:000053278][18007] -> osm_mcmr_rcv_join_mgrp: Dump of</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">incomming record.</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">[1102546997:000053307][18007] -> MCMember Record dump:</FONT></P>
<P ALIGN=LEFT> </P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">MGID....................0xff12401bffff0000 : 0x0000000000000016</FONT></P>
<P ALIGN=LEFT> </P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">PortGid.................0xfe80000000000000 : 0x0002c9010ad25b91</FONT></P>
<P ALIGN=LEFT> <FONT COLOR="#0000FF" FACE="Palatino Linotype">qkey....................0x0</FONT></P>
<P ALIGN=LEFT> <FONT COLOR="#0000FF" FACE="Palatino Linotype">Mlid....................0x0</FONT></P>
<P ALIGN=LEFT> <FONT COLOR="#0000FF" FACE="Palatino Linotype">ScopeState..............0x1</FONT></P>
<P ALIGN=LEFT> <FONT COLOR="#0000FF" FACE="Palatino Linotype">Rate....................0x0</FONT></P>
<P ALIGN=LEFT> <FONT COLOR="#0000FF" FACE="Palatino Linotype">Mtu.....................0x0</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">[1102546997:000053334][18007] -> osm_physp_share_pkey: [</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">[1102546997:000053358][18007] -> osm_physp_share_pkey: ]</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">[1102546997:000053389][18007] -> osm_mcmr_rcv_join_mgrp: ERR 1B11:</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">method = SubnAdmSet,scope_state = 0x1, component mask =</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">0x0000000000010083, expected comp mask = 0x00000000000130c7.</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">[1102546997:000053413][18007] -> osm_sa_send_error: [</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">[1102546997:000053434][18007] -> osm_mad_pool_get: [</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">[1102546997:000053457][18007] -> osm_vendor_get: [</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">[1102546997:000053481][18007] -> osm_vendor_get: Allocated MAD</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">0x818a860, size = 256.</FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype"> </FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype"> </FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype"> </FONT></P>
<P ALIGN=LEFT><FONT COLOR="#0000FF" FACE="Palatino Linotype">_</FONT></P>
</BODY>
</HTML>