[openib-general] IB mcast question
Hal Rosenstock
halr at voltaire.com
Tue Aug 15 13:28:16 PDT 2006
On Tue, 2006-08-15 at 16:07, Steve Wise wrote:
> On Tue, 2006-08-15 at 12:39 -0700, Sean Hefty wrote:
> > >Why are these separated? Isn't an address handle needed for each
> > >destination QP? If so, then why is the remote qpn/qkey also needed to
> > >transmit a datagram?
> >
> > The address handle doesn't include QPN/QKey information. Maybe think of them
> > more as specifying the path to some port.
> >
>
> Ok.
>
> >From what I can tell via experimentation, the qkey of the mcast group
> doesn't need to have any relation to the qkeys of the qps.
That may be what is happening but I don't think that is correct (per the
IBA spec).
> I was able to create a mcast group with the mc qkey==0xe00a0a0a,
Don't we need to be careful about controlled Q_Keys as well ?
-- Hal
> and 3 apps joined this group, but their qp qkeys were 0 (I changed
> ucma_init_ud_qp() to set the qp qkey to 0). One app sent to the mcgroup
> ah/qkey/qpn and the other two received the packet. Does that make
> sense?
>
> So maybe all we need is the concept of REUSE_PORT to allow multiple
> librdma users to create cm_ids with the same local port. currently this
> isn't allowed. If we do this, then all processes that want to exchange
> mcast packets would create cm_ids and do rdma_resolve_addr() with the
> same src port number on all systems.
>
> Senders send to the ah/remote_qpn/remote_qkey of the mcast group. This
> routes packets to all IB ports that have subscribers. Then since the
> sender's qp has the same qkey as all the group participants each qp will
> receive a copy of the packet.
>
> The mcast setup code in librdma doesn't need to change. IE the qkey can
> remain the ip mcast address.
>
> I think this will work. It is similar to UDP/IP/MCAST...
>
> Or am I all wet?
>
> whatchathink?
>
>
>
> _______________________________________________
> openib-general mailing list
> openib-general at openib.org
> http://openib.org/mailman/listinfo/openib-general
>
> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
>
More information about the general
mailing list