<div dir="ltr">Sorry for not mentioning the VxWorks environment. I'll retest the snooping routine after fixing the failure.<div><br></div><div>Thanks for the help!</div></div><div class="gmail_extra"><br><br><div class="gmail_quote">
On Tue, Apr 8, 2014 at 11:47 AM, Hal Rosenstock <span dir="ltr"><<a href="mailto:hal@dev.mellanox.co.il" target="_blank">hal@dev.mellanox.co.il</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div class="">On 4/8/2014 12:41 PM, Yunzhao li wrote:<br>
> The Connect-IB node is configured by the switch SM, and it can<br>
> send/receive traffic with other connected Connect-IB nodes. We pulled<br>
> OFED-2.1 into our VxWorks environment,<br>
<br>
</div>You hadn't mentioned you were talking about vxWorks rather than Linux.<br>
<div class=""><br>
> so it's a little difficult to run<br>
> linux commands for verification. For the Connect-IB port: the port state<br>
> is "defer" and link state is "active".<br>
<br>
</div>LinkActDefer means that the physical layer has indicated a failure in<br>
the link.<br>
<div class=""><br>
><br>
> On Tue, Apr 8, 2014 at 11:25 AM, Hal Rosenstock <<a href="mailto:hal@dev.mellanox.co.il">hal@dev.mellanox.co.il</a><br>
</div><div><div class="h5">> <mailto:<a href="mailto:hal@dev.mellanox.co.il">hal@dev.mellanox.co.il</a>>> wrote:<br>
><br>
> On 4/8/2014 12:13 PM, Yunzhao li wrote:<br>
> > We are working on the newest IB card: Mellanox Connect-IB. We pulled<br>
> > Mellanox OFED-2.1 into our environment. The IB nodes are connected<br>
> > through Mellanox SX3036 switch. We exactly followed Sean Hefty's<br>
> madeye<br>
> > code: using ib_register_mad_snoop() for registration and using<br>
> > ib_mad_snoop_handler() and ib_mad_recv_handler() to handle the<br>
> sent and<br>
> > received MAD packets respectively. However, the most captured SM<br>
> packets<br>
> > are DevMgt (0x06), and we haven't received any class 0x81 or class<br>
> 0x01<br>
> > MADs.<br>
> ><br>
> > Does the snooping mad routine need the support of HCA<br>
> hardware/firmware?<br>
> > Or, does it need the support of ibdump package?<br>
><br>
> I don't have access to Connect-IB so don't know for sure but my<br>
> understanding is that a Connect-IB port can be configured by an external<br>
> SM and that an SM can be run on the Connect-IB port so you should be<br>
> able to capture send and receive SM class packets.<br>
><br>
> Also, PMA should be supported and you can double check this with<br>
> perfquery.<br>
><br>
> All of the above involves kernel interaction (for even SMA/PMA) so<br>
> snooping should work AFAIK.<br>
><br>
> What does ibstat say for your Connect-IB port ?<br>
><br>
> -- Hal<br>
><br>
> ><br>
> > Thanks!<br>
> ><br>
> ><br>
> > On Mon, Apr 7, 2014 at 7:50 PM, Hal Rosenstock<br>
> <<a href="mailto:hal@dev.mellanox.co.il">hal@dev.mellanox.co.il</a> <mailto:<a href="mailto:hal@dev.mellanox.co.il">hal@dev.mellanox.co.il</a>><br>
</div></div>> > <mailto:<a href="mailto:hal@dev.mellanox.co.il">hal@dev.mellanox.co.il</a> <mailto:<a href="mailto:hal@dev.mellanox.co.il">hal@dev.mellanox.co.il</a>>>><br>
<div class="HOEnZb"><div class="h5">> wrote:<br>
> ><br>
> ><br>
> > > We try to use IB MAD snoop to capture IB mad packets.<br>
> ><br>
> > Note that there is old kernel util module madeye written by<br>
> Sean which<br>
> > does this:<br>
> ><br>
> ><br>
> <a href="http://git.openfabrics.org/?p=ofed_1_5/linux-2.6.git;a=blob;f=drivers/infiniband/util/madeye.c;h=2c650a33a69c56d2b8a3274f63185214904abf3a;hb=967460824529719677d6a1d4600ec3e89a4538ab" target="_blank">http://git.openfabrics.org/?p=ofed_1_5/linux-2.6.git;a=blob;f=drivers/infiniband/util/madeye.c;h=2c650a33a69c56d2b8a3274f63185214904abf3a;hb=967460824529719677d6a1d4600ec3e89a4538ab</a><br>
> ><br>
> > which shows how to properly use the ib_register_mad_snoop API<br>
> for both<br>
> > SM and GS class MAD snooping.<br>
> ><br>
> > > However, currently<br>
> > > only the classes of DevMgt (0x06) and ComMgt (0x07) could be<br>
> > snooped. We<br>
> > > tried to run tests based on class Perf (0x04) and class Subn<br>
> > (0x01) mad,<br>
> > > and neither of them can be captured. Any suggestion?<br>
> ><br>
> > In the distant past, I've used madeye and captured SM, SA, and<br>
> PerfMgt<br>
> > packets.<br>
> ><br>
> > Assuming your snoop registration(s) is/are correct:<br>
> > Most SM packets are class 0x81 (directed route) and not class<br>
> 0x01 (LID<br>
> > routed) but this is SM dependent. Also, it might be that there<br>
> is no<br>
> > PerfMgt running to/from your node.<br>
> ><br>
> > -- Hal<br>
> ><br>
> > ><br>
> > ><br>
> > > Thanks in advance!<br>
> > ><br>
> > ><br>
> > ><br>
> > > Yunzhao<br>
> ><br>
> ><br>
><br>
><br>
<br>
</div></div></blockquote></div><br></div>