[openib-general] IPoIB question

[Abhijit Gadgil]

Hi All,

I am new to IPoIB. I have a query, as per the IPoIB Architecture
document, whenever an IPoIB interface is brought up, it needs to do a
Full Member Join to the "broadcast" Multicast group. Where exactly in
the code, is this taking place? I have been able to trace a little bit -
eg. in ipoib_add_port() there is a call to ipoib_intf_alloc() which in
turn creates a Work Queue for the ipoib_mcast_restart_task(). In this
task, subsequently there is _ipoib_mcast_join() and so on where it
finally reaches ipoib_mcast_attach() (in ipoib_verbs.c). What is not
clear at this point is, Why is it looking for cached PKey? Is it not
something that needs to be sent by the SM? 

Further, I am putting SM in testability 'debug' mode (DEBUG=10 in
/etc/opensm.conf), however I am still not seeing any dump of messages
about FullMember join whenever I try restarting the IB interfaces. What
should be log-level to put SM to dump those messages? 

Thanks in advance. 

Regards.

-abhijit