[ofa-general] SA code?

[Yicheng Jia]

> Not if the communication is just within each subnet; only if it is
> across subnets.
It will cross the subnets. For my case, each node has the need of sending 
message to other nodes than its neighbor, e.g. A -> D or E->B.

Thanks!
Yicheng




Hal Rosenstock <hrosenstock at xsigo.com> 
02/01/2008 05:43 PM

To
Yicheng Jia <YJia at tmriusa.com>
cc
general at lists.openfabrics.org, Roland Dreier <rdreier at cisco.com>
Subject
Re: [ofa-general] SA code?






On Fri, 2008-02-01 at 17:07 -0600, Yicheng Jia wrote:
> 
> > Are you saying all messages are between adjacent neighbors on the
> ring ? 
> Yes. Say I have 6 nodes: A, B, C, D, E, F, then the ring topo will be
> A<->B, B<->C, C<->D, D<->E, E<->F, F<->A, and there are totally 6
> subnets. 
> 
> > If it is just A->B, B->C, ..., and never across the ring, then this
> can
> > work but you need an SM instance per subnet.
> Do I need a router per subnet as well? 

Not if the communication is just within each subnet; only if it is
across subnets.

> > If you need some router mode, then this is still a work in progress
> for
> > InfiniBand although you might be able to get to a proprietary
> solution
> > in the short term. 
> What version of OFED will have router mode available? 

There's already the beginnings of this but I don't know when a complete
solution would be available.

-- Hal

> Thanks! 
> Yicheng
> 
> 
> 
> Hal Rosenstock
> <hrosenstock at xsigo.com> 
> 
> 02/01/2008 04:45 PM 
> 
> 
>                To
> Yicheng Jia
> <YJia at tmriusa.com> 
>                cc
> general at lists.openfabrics.org, Roland Dreier <rdreier at cisco.com> 
>           Subject
> Re: [ofa-general]
> SA code?
> 
> 
> 
> 
> 
> 
> 
> 
> Hi Yicheng,
> 
> On Fri, 2008-02-01 at 16:38 -0600, Yicheng Jia wrote:
> > 
> > Hi Hal, 
> > 
> > The only reason is cost down.
> 
> Understood.
> 
> >  The cost of IB switch weighs too much in our product, it seems the
> > ring topology is the only way to go. There's no message across the
> > ring, all the communication occurs within the ring. 
> 
> Are you saying all messages are between adjacent neighbors on the
> ring ?
> 
> > Would it cause the performance substantially go down? 
> 
> If it is just A->B, B->C, ..., and never across the ring, then this
> can
> work but you need an SM instance per subnet.
> 
> If you need some router mode, then this is still a work in progress
> for
> InfiniBand although you might be able to get to a proprietary solution
> in the short term.
> 
> -- Hal
> 
> > Thanks!
> > Yicheng 
> > 
> > 
> > 
> > Hal Rosenstock
> > <hrosenstock at xsigo.com> 
> > 
> > 02/01/2008 04:25 PM 
> > 
> > 
> >                To
> > Yicheng Jia
> > <YJia at tmriusa.com> 
> >                cc
> > Roland Dreier
> > <rdreier at cisco.com>, general at lists.openfabrics.org 
> >           Subject
> > Re: [ofa-general]
> > SA code?
> > 
> > 
> > 
> > 
> > 
> > 
> > 
> > 
> > On Fri, 2008-02-01 at 16:14 -0600, Yicheng Jia wrote:
> > > 
> > > Hi Roland, 
> > > 
> > > Is there SA code available in OFED? I have a IB switch to connect
> > all
> > > the mellanox HCAs, the SA is running on the switch's firmware. My
> > goal
> > > is to skip the switch and use ring topology to connect the HCA
> with
> > > each other. Is it doable in OFED? 
> > 
> > I don't understand what you're trying to accomplish with this
> > topology.
> > In IB speak, each HCA <-> HCA link would be a separate subnet. Do
> you
> > intend to forward across your ring ? If so, only some "router" mode
> > would allow that with the topology you propose.
> > 
> > -- Hal
> > 
> > > Thanks!
> > > Yicheng
> > > _______________________________________________
> > > general mailing list
> > > general at lists.openfabrics.org
> > > http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
> > > 
> > > To unsubscribe, please visit
> > http://openib.org/mailman/listinfo/openib-general
> > 
> > 
> >
> 
_____________________________________________________________________________
> > Scanned by IBM Email Security Management Services powered by
> > MessageLabs. For more information please visit
> http://www.ers.ibm.com
> >
> 
_____________________________________________________________________________
> > 
> 
> 
> 
_____________________________________________________________________________
> Scanned by IBM Email Security Management Services powered by
> MessageLabs. For more information please visit http://www.ers.ibm.com
> 
_____________________________________________________________________________
> 


_____________________________________________________________________________
Scanned by IBM Email Security Management Services powered by MessageLabs. 
For more information please visit http://www.ers.ibm.com
_____________________________________________________________________________

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20080201/728f52c2/attachment.html>