On Fri, 2008-02-01 at 17:07 -0600, Yicheng Jia wrote: > > > Are you saying all messages are between adjacent neighbors on the > ring ? > Yes. Say I have 6 nodes: A, B, C, D, E, F, then the ring topo will be > A<->B, B<->C, C<->D, D<->E, E<->F, F<->A, and there are totally 6 > subnets. > > > If it is just A->B, B->C, ..., and never across the ring, then this > can > > work but you need an SM instance per subnet. > Do I need a router per subnet as well?
Not if the communication is just within each subnet; only if it is across subnets. > > If you need some router mode, then this is still a work in progress > for > > InfiniBand although you might be able to get to a proprietary > solution > > in the short term. > What version of OFED will have router mode available? There's already the beginnings of this but I don't know when a complete solution would be available. -- Hal > Thanks! > Yicheng > > > > Hal Rosenstock > <[EMAIL PROTECTED]> > > 02/01/2008 04:45 PM > > > To > Yicheng Jia > <[EMAIL PROTECTED]> > cc > [email protected], Roland Dreier <[EMAIL PROTECTED]> > Subject > Re: [ofa-general] > SA code? > > > > > > > > > Hi Yicheng, > > On Fri, 2008-02-01 at 16:38 -0600, Yicheng Jia wrote: > > > > Hi Hal, > > > > The only reason is cost down. > > Understood. > > > The cost of IB switch weighs too much in our product, it seems the > > ring topology is the only way to go. There's no message across the > > ring, all the communication occurs within the ring. > > Are you saying all messages are between adjacent neighbors on the > ring ? > > > Would it cause the performance substantially go down? > > If it is just A->B, B->C, ..., and never across the ring, then this > can > work but you need an SM instance per subnet. > > If you need some router mode, then this is still a work in progress > for > InfiniBand although you might be able to get to a proprietary solution > in the short term. > > -- Hal > > > Thanks! > > Yicheng > > > > > > > > Hal Rosenstock > > <[EMAIL PROTECTED]> > > > > 02/01/2008 04:25 PM > > > > > > To > > Yicheng Jia > > <[EMAIL PROTECTED]> > > cc > > Roland Dreier > > <[EMAIL PROTECTED]>, [email protected] > > Subject > > Re: [ofa-general] > > SA code? > > > > > > > > > > > > > > > > > > On Fri, 2008-02-01 at 16:14 -0600, Yicheng Jia wrote: > > > > > > Hi Roland, > > > > > > Is there SA code available in OFED? I have a IB switch to connect > > all > > > the mellanox HCAs, the SA is running on the switch's firmware. My > > goal > > > is to skip the switch and use ring topology to connect the HCA > with > > > each other. Is it doable in OFED? > > > > I don't understand what you're trying to accomplish with this > > topology. > > In IB speak, each HCA <-> HCA link would be a separate subnet. Do > you > > intend to forward across your ring ? If so, only some "router" mode > > would allow that with the topology you propose. > > > > -- Hal > > > > > Thanks! > > > Yicheng > > > _______________________________________________ > > > general mailing list > > > [email protected] > > > http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general > > > > > > To unsubscribe, please visit > > http://openib.org/mailman/listinfo/openib-general > > > > > > > _____________________________________________________________________________ > > Scanned by IBM Email Security Management Services powered by > > MessageLabs. For more information please visit > http://www.ers.ibm.com > > > _____________________________________________________________________________ > > > > > _____________________________________________________________________________ > Scanned by IBM Email Security Management Services powered by > MessageLabs. For more information please visit http://www.ers.ibm.com > _____________________________________________________________________________ > _______________________________________________ general mailing list [email protected] http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
