[ofa-general] SA code?

[Yicheng Jia]

Unfortunately I have 9 nodes.

Thanks!
Yicheng




"Timothy A. Meier" <meier3 at llnl.gov> 
02/01/2008 05:39 PM

To
Yicheng Jia <YJia at tmriusa.com>
cc
general at lists.openfabrics.org
Subject
Re: [ofa-general] SA code?






Yicheng Jia wrote:
> 
>  > Are you saying all messages are between adjacent neighbors on the 
ring ?
> Yes. Say I have 6 nodes: A, B, C, D, E, F, then the ring topo will be 
> A<->B, B<->C, C<->D, D<->E, E<->F, F<->A, and there are totally 6 
subnets.

If you only plan on 6 nodes, you can get an 8 port switch for ~ $750
http://www.colfaxdirect.com/store/pc/viewCategories.asp?pageStyle=m&idCategory=7


> 
>  > If it is just A->B, B->C, ..., and never across the ring, then this 
can
>  > work but you need an SM instance per subnet.
> Do I need a router per subnet as well?
> 
>  > If you need some router mode, then this is still a work in progress 
for
>  > InfiniBand although you might be able to get to a proprietary 
solution
>  > in the short term.
> What version of OFED will have router mode available?
> 
> Thanks!
> Yicheng
> 
> 
> 
> *Hal Rosenstock <hrosenstock at xsigo.com>*
> 
> 02/01/2008 04:45 PM
> 
> 
> To
>                Yicheng Jia <YJia at tmriusa.com>
> cc
>                general at lists.openfabrics.org, Roland Dreier 
<rdreier at cisco.com>
> Subject
>                Re: [ofa-general] SA code?
> 
> 
> 
> 
> 
> 
> 
> 
> Hi Yicheng,
> 
> On Fri, 2008-02-01 at 16:38 -0600, Yicheng Jia wrote:
>  >
>  > Hi Hal,
>  >
>  > The only reason is cost down.
> 
> Understood.
> 
>  >  The cost of IB switch weighs too much in our product, it seems the
>  > ring topology is the only way to go. There's no message across the
>  > ring, all the communication occurs within the ring.
> 
> Are you saying all messages are between adjacent neighbors on the ring ?
> 
>  > Would it cause the performance substantially go down?
> 
> If it is just A->B, B->C, ..., and never across the ring, then this can
> work but you need an SM instance per subnet.
> 
> If you need some router mode, then this is still a work in progress for
> InfiniBand although you might be able to get to a proprietary solution
> in the short term.
> 
> -- Hal
> 
>  > Thanks!
>  > Yicheng
>  >
>  >
>  >
>  > Hal Rosenstock
>  > <hrosenstock at xsigo.com>
>  >
>  > 02/01/2008 04:25 PM
>  >
>  >
>  >                To
>  > Yicheng Jia
>  > <YJia at tmriusa.com>
>  >                cc
>  > Roland Dreier
>  > <rdreier at cisco.com>, general at lists.openfabrics.org
>  >           Subject
>  > Re: [ofa-general]
>  > SA code?
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  >
>  > On Fri, 2008-02-01 at 16:14 -0600, Yicheng Jia wrote:
>  > >
>  > > Hi Roland,
>  > >
>  > > Is there SA code available in OFED? I have a IB switch to connect
>  > all
>  > > the mellanox HCAs, the SA is running on the switch's firmware. My
>  > goal
>  > > is to skip the switch and use ring topology to connect the HCA with
>  > > each other. Is it doable in OFED?
>  >
>  > I don't understand what you're trying to accomplish with this
>  > topology.
>  > In IB speak, each HCA <-> HCA link would be a separate subnet. Do you
>  > intend to forward across your ring ? If so, only some "router" mode
>  > would allow that with the topology you propose.
>  >
>  > -- Hal
>  >
>  > > Thanks!
>  > > Yicheng
>  > > _______________________________________________
>  > > general mailing list
>  > > general at lists.openfabrics.org
>  > > http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
>  > >
>  > > To unsubscribe, please visit
>  > http://openib.org/mailman/listinfo/openib-general
>  >
>  >
>  > 
> 
_____________________________________________________________________________
>  > Scanned by IBM Email Security Management Services powered by
>  > MessageLabs. For more information please visit http://www.ers.ibm.com
>  > 
> 
_____________________________________________________________________________
>  >
> 
> 
> 
_____________________________________________________________________________
> Scanned by IBM Email Security Management Services powered by 
> MessageLabs. For more information please visit http://www.ers.ibm.com
> 
_____________________________________________________________________________
> 
> 
> ------------------------------------------------------------------------
> 
> _______________________________________________
> general mailing list
> general at lists.openfabrics.org
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
> 
> To unsubscribe, please visit 
http://openib.org/mailman/listinfo/openib-general


-- 
Timothy A. Meier
Computer Scientist
ICCD/High Performance Computing
925.422.3341
meier3 at llnl.gov

_____________________________________________________________________________
Scanned by IBM Email Security Management Services powered by MessageLabs. 
For more information please visit http://www.ers.ibm.com
_____________________________________________________________________________

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openfabrics.org/pipermail/general/attachments/20080201/daea21ff/attachment.html>