Unfortunately I have 9 nodes. Thanks! Yicheng
"Timothy A. Meier" <[EMAIL PROTECTED]> 02/01/2008 05:39 PM To Yicheng Jia <[EMAIL PROTECTED]> cc [email protected] Subject Re: [ofa-general] SA code? Yicheng Jia wrote: > > > Are you saying all messages are between adjacent neighbors on the ring ? > Yes. Say I have 6 nodes: A, B, C, D, E, F, then the ring topo will be > A<->B, B<->C, C<->D, D<->E, E<->F, F<->A, and there are totally 6 subnets. If you only plan on 6 nodes, you can get an 8 port switch for ~ $750 http://www.colfaxdirect.com/store/pc/viewCategories.asp?pageStyle=m&idCategory=7 > > > If it is just A->B, B->C, ..., and never across the ring, then this can > > work but you need an SM instance per subnet. > Do I need a router per subnet as well? > > > If you need some router mode, then this is still a work in progress for > > InfiniBand although you might be able to get to a proprietary solution > > in the short term. > What version of OFED will have router mode available? > > Thanks! > Yicheng > > > > *Hal Rosenstock <[EMAIL PROTECTED]>* > > 02/01/2008 04:45 PM > > > To > Yicheng Jia <[EMAIL PROTECTED]> > cc > [email protected], Roland Dreier <[EMAIL PROTECTED]> > Subject > Re: [ofa-general] SA code? > > > > > > > > > Hi Yicheng, > > On Fri, 2008-02-01 at 16:38 -0600, Yicheng Jia wrote: > > > > Hi Hal, > > > > The only reason is cost down. > > Understood. > > > The cost of IB switch weighs too much in our product, it seems the > > ring topology is the only way to go. There's no message across the > > ring, all the communication occurs within the ring. > > Are you saying all messages are between adjacent neighbors on the ring ? > > > Would it cause the performance substantially go down? > > If it is just A->B, B->C, ..., and never across the ring, then this can > work but you need an SM instance per subnet. > > If you need some router mode, then this is still a work in progress for > InfiniBand although you might be able to get to a proprietary solution > in the short term. > > -- Hal > > > Thanks! > > Yicheng > > > > > > > > Hal Rosenstock > > <[EMAIL PROTECTED]> > > > > 02/01/2008 04:25 PM > > > > > > To > > Yicheng Jia > > <[EMAIL PROTECTED]> > > cc > > Roland Dreier > > <[EMAIL PROTECTED]>, [email protected] > > Subject > > Re: [ofa-general] > > SA code? > > > > > > > > > > > > > > > > > > On Fri, 2008-02-01 at 16:14 -0600, Yicheng Jia wrote: > > > > > > Hi Roland, > > > > > > Is there SA code available in OFED? I have a IB switch to connect > > all > > > the mellanox HCAs, the SA is running on the switch's firmware. My > > goal > > > is to skip the switch and use ring topology to connect the HCA with > > > each other. Is it doable in OFED? > > > > I don't understand what you're trying to accomplish with this > > topology. > > In IB speak, each HCA <-> HCA link would be a separate subnet. Do you > > intend to forward across your ring ? If so, only some "router" mode > > would allow that with the topology you propose. > > > > -- Hal > > > > > Thanks! > > > Yicheng > > > _______________________________________________ > > > general mailing list > > > [email protected] > > > http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general > > > > > > To unsubscribe, please visit > > http://openib.org/mailman/listinfo/openib-general > > > > > > > _____________________________________________________________________________ > > Scanned by IBM Email Security Management Services powered by > > MessageLabs. For more information please visit http://www.ers.ibm.com > > > _____________________________________________________________________________ > > > > > _____________________________________________________________________________ > Scanned by IBM Email Security Management Services powered by > MessageLabs. For more information please visit http://www.ers.ibm.com > _____________________________________________________________________________ > > > ------------------------------------------------------------------------ > > _______________________________________________ > general mailing list > [email protected] > http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general > > To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general -- Timothy A. Meier Computer Scientist ICCD/High Performance Computing 925.422.3341 [EMAIL PROTECTED] _____________________________________________________________________________ Scanned by IBM Email Security Management Services powered by MessageLabs. For more information please visit http://www.ers.ibm.com _____________________________________________________________________________
_______________________________________________ general mailing list [email protected] http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
