[ofa-general] RE: Problem with using two interfaces with rdma-cm

Sundeep Narravula narravul at cse.ohio-state.edu
Wed May 23 18:40:10 PDT 2007


  This suggestion seems like its working. I have been able to run the test
successfully several times so far with any of the earlier problems.

Thanks,
  --Sundeep.

On Wed, 23 May 2007, Steve Wise wrote:

> Guys, this reminds me of an issue we have with rnics and regular nics on
> the same physical network.  By default linux responds to arp queries on
> all ports it receives the query on.  This leads to very bad results with
> you're trying to do offloaded connections.  When resolving the
> address/route, the rdma client can end up getting the mac address of the
> dumb nic instead of the rnic.   I don't know if route resolution in the
> ib cm has this issue, but it might since they use ipoib for some part of
> the resolution, no?
>
> You might this (snipit from the cxgb3 release notes file to be included
> in -rc4):
>
> 2) If you have a multi-homed host and the physical ethernet networks are
> bridged, then you need to configure arp to only send replies on the
> interface with the target ip address:
>
>         sysctl -w net.ipv4.conf.all.arp_ignore=2
>
> Steve.
>
> Sundeep Narravula wrote:
> >> Odd - I will see if I can reproduce this.
> >>
> >> Are the HCAs sharing the same IB subnet?
> >>
> >
> > Yes. They are in the same IB subnet.
> >
> >
> >>> hmm.. I can try this but as an last resort. Ideally I would like to use
> >>> just one listen cm_id binded to 0.0.0.0.
> >>>
> >> I was thinking about binding on the active side, before calling connect.  But I
> >> still want to look into this more.
> >>
> >
> > I can try this one out.
> >
> >   --Sundeep.
> >
> >
> >> - Sean
> >>
> >>
> >
> > _______________________________________________
> > general mailing list
> > general at lists.openfabrics.org
> > http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
> >
> > To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
> >
>




More information about the general mailing list