Yicheng Jia wrote:
> Are you saying all messages are between adjacent neighbors on the ring ?
Yes. Say I have 6 nodes: A, B, C, D, E, F, then the ring topo will be
A<->B, B<->C, C<->D, D<->E, E<->F, F<->A, and there are totally 6 subnets.
If you only plan on 6 nodes, you can get an 8 port switch for ~ $750
http://www.colfaxdirect.com/store/pc/viewCategories.asp?pageStyle=m&idCategory=7
> If it is just A->B, B->C, ..., and never across the ring, then this can
> work but you need an SM instance per subnet.
Do I need a router per subnet as well?
> If you need some router mode, then this is still a work in progress for
> InfiniBand although you might be able to get to a proprietary solution
> in the short term.
What version of OFED will have router mode available?
Thanks!
Yicheng
*Hal Rosenstock <[EMAIL PROTECTED]>*
02/01/2008 04:45 PM
To
Yicheng Jia <[EMAIL PROTECTED]>
cc
[email protected], Roland Dreier <[EMAIL PROTECTED]>
Subject
Re: [ofa-general] SA code?
Hi Yicheng,
On Fri, 2008-02-01 at 16:38 -0600, Yicheng Jia wrote:
>
> Hi Hal,
>
> The only reason is cost down.
Understood.
> The cost of IB switch weighs too much in our product, it seems the
> ring topology is the only way to go. There's no message across the
> ring, all the communication occurs within the ring.
Are you saying all messages are between adjacent neighbors on the ring ?
> Would it cause the performance substantially go down?
If it is just A->B, B->C, ..., and never across the ring, then this can
work but you need an SM instance per subnet.
If you need some router mode, then this is still a work in progress for
InfiniBand although you might be able to get to a proprietary solution
in the short term.
-- Hal
> Thanks!
> Yicheng
>
>
>
> Hal Rosenstock
> <[EMAIL PROTECTED]>
>
> 02/01/2008 04:25 PM
>
>
> To
> Yicheng Jia
> <[EMAIL PROTECTED]>
> cc
> Roland Dreier
> <[EMAIL PROTECTED]>, [email protected]
> Subject
> Re: [ofa-general]
> SA code?
>
>
>
>
>
>
>
>
> On Fri, 2008-02-01 at 16:14 -0600, Yicheng Jia wrote:
> >
> > Hi Roland,
> >
> > Is there SA code available in OFED? I have a IB switch to connect
> all
> > the mellanox HCAs, the SA is running on the switch's firmware. My
> goal
> > is to skip the switch and use ring topology to connect the HCA with
> > each other. Is it doable in OFED?
>
> I don't understand what you're trying to accomplish with this
> topology.
> In IB speak, each HCA <-> HCA link would be a separate subnet. Do you
> intend to forward across your ring ? If so, only some "router" mode
> would allow that with the topology you propose.
>
> -- Hal
>
> > Thanks!
> > Yicheng
> > _______________________________________________
> > general mailing list
> > [email protected]
> > http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
> >
> > To unsubscribe, please visit
> http://openib.org/mailman/listinfo/openib-general
>
>
>
_____________________________________________________________________________
> Scanned by IBM Email Security Management Services powered by
> MessageLabs. For more information please visit http://www.ers.ibm.com
>
_____________________________________________________________________________
>
_____________________________________________________________________________
Scanned by IBM Email Security Management Services powered by
MessageLabs. For more information please visit http://www.ers.ibm.com
_____________________________________________________________________________
------------------------------------------------------------------------
_______________________________________________
general mailing list
[email protected]
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
--
Timothy A. Meier
Computer Scientist
ICCD/High Performance Computing
925.422.3341
[EMAIL PROTECTED]
_______________________________________________
general mailing list
[email protected]
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
