RE: [ofa-general] oversubscription
Your question made it clear :) We are still using only one SFS-7000P switch. Routing is here not an option. This was our setup: s1 | | | | SFS-7000P || | | h1 h2 h3 h4 So change the routing will give no benefit what so ever... Greetz Koen From: Yevgeny Kliteynik [mailto:[EMAIL PROTECTED] Sent: Wed 3/14/2007 8:24 AM To: Hal Rosenstock Cc: SEGERS Koen; [email protected] Subject: Re: [ofa-general] oversubscription Hal Rosenstock wrote: > On Tue, 2007-03-13 at 17:30, SEGERS Koen wrote: >> I'm trying to resolve an oversubscription problem of 1 server >> receiving streams from 4 hosts. >> >> If you connect the server with 4 cables to the switch, it should be >> resolved when I define the routes that should be used. But is it >> possible to define the routing tables in the subnet manager? > > Depends on the SM as to whether this is supported or not. OpenSM > supports the ability to do this as do some vendor SMs. > >> Maybe just running the fattree routing module is sufficient? > > I'm not sure; Yevgeny would be the best to answer this. What is the fabric topology? Basically, you can try using fat-tree routing, and if the topology is not a fat-tree, OpenSM will issue an error message and will use default routing. You can get more details from the osm/doc/current-routing.txt -- Yevgeny >> I also saw that it is possible to set the routes by using a file. Can >> someone give an example of this? > > This capability is documented in the opensm man page. You can obtain > this file via dump_lfts.sh script. > >> Currently I'm trying a combination of partitioning and linux routing. >> Is this a good idea? > > What do you mean by Linux routing ? Is this IP routing ? > > -- Hal > >> BTW: we are only interested in SDP and IPoIB. In a previous thread I >> discovered that bonding/aggregation/merging is not possible in an >> active/active situation. So this doesn't improve our setup. >> >> greetz, >> >> Koen >> *** Disclaimer *** >> >> Vlaamse Radio- en Televisieomroep >> Auguste Reyerslaan 52, 1043 Brussel >> >> nv van publiek recht >> BTW BE 0244.142.664 >> RPR Brussel >> http://www.vrt.be/disclaimer >> >> >> >> __ >> >> ___ >> general mailing list >> [email protected] >> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general >> >> To unsubscribe, please visit >> http://openib.org/mailman/listinfo/openib-general > > ___ > general mailing list > [email protected] > http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general > > To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general > *** Disclaimer *** Vlaamse Radio- en Televisieomroep Auguste Reyerslaan 52, 1043 Brussel nv van publiek recht BTW BE 0244.142.664 RPR Brussel http://www.vrt.be/disclaimer ___ general mailing list [email protected] http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [ofa-general] oversubscription
On Wed, 2007-03-14 at 02:24, Yevgeny Kliteynik wrote: > Hal Rosenstock wrote: > > On Tue, 2007-03-13 at 17:30, SEGERS Koen wrote: > >> I'm trying to resolve an oversubscription problem of 1 server > >> receiving streams from 4 hosts. > >> > >> If you connect the server with 4 cables to the switch, it should be > >> resolved when I define the routes that should be used. But is it > >> possible to define the routing tables in the subnet manager? > > > > Depends on the SM as to whether this is supported or not. OpenSM > > supports the ability to do this as do some vendor SMs. > > > >> Maybe just running the fattree routing module is sufficient? > > > > I'm not sure; Yevgeny would be the best to answer this. > > What is the fabric topology? > > Basically, you can try using fat-tree routing, and if the topology > is not a fat-tree, OpenSM will issue an error message and will use > default routing. > You can get more details from the osm/doc/current-routing.txt Same info on fat tree is in the opensm man page. -- Hal > -- Yevgeny > > >> I also saw that it is possible to set the routes by using a file. Can > >> someone give an example of this? > > > > This capability is documented in the opensm man page. You can obtain > > this file via dump_lfts.sh script. > > > >> Currently I'm trying a combination of partitioning and linux routing. > >> Is this a good idea? > > > > What do you mean by Linux routing ? Is this IP routing ? > > > > -- Hal > > > >> BTW: we are only interested in SDP and IPoIB. In a previous thread I > >> discovered that bonding/aggregation/merging is not possible in an > >> active/active situation. So this doesn't improve our setup. > >> > >> greetz, > >> > >> Koen > >> *** Disclaimer *** > >> > >> Vlaamse Radio- en Televisieomroep > >> Auguste Reyerslaan 52, 1043 Brussel > >> > >> nv van publiek recht > >> BTW BE 0244.142.664 > >> RPR Brussel > >> http://www.vrt.be/disclaimer > >> > >> > >> > >> __ > >> > >> ___ > >> general mailing list > >> [email protected] > >> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general > >> > >> To unsubscribe, please visit > >> http://openib.org/mailman/listinfo/openib-general > > > > ___ > > general mailing list > > [email protected] > > http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general > > > > To unsubscribe, please visit > > http://openib.org/mailman/listinfo/openib-general > > > ___ general mailing list [email protected] http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [ofa-general] oversubscription
Hal Rosenstock wrote: On Tue, 2007-03-13 at 17:30, SEGERS Koen wrote: I'm trying to resolve an oversubscription problem of 1 server receiving streams from 4 hosts. If you connect the server with 4 cables to the switch, it should be resolved when I define the routes that should be used. But is it possible to define the routing tables in the subnet manager? Depends on the SM as to whether this is supported or not. OpenSM supports the ability to do this as do some vendor SMs. Maybe just running the fattree routing module is sufficient? I'm not sure; Yevgeny would be the best to answer this. What is the fabric topology? Basically, you can try using fat-tree routing, and if the topology is not a fat-tree, OpenSM will issue an error message and will use default routing. You can get more details from the osm/doc/current-routing.txt -- Yevgeny I also saw that it is possible to set the routes by using a file. Can someone give an example of this? This capability is documented in the opensm man page. You can obtain this file via dump_lfts.sh script. Currently I'm trying a combination of partitioning and linux routing. Is this a good idea? What do you mean by Linux routing ? Is this IP routing ? -- Hal BTW: we are only interested in SDP and IPoIB. In a previous thread I discovered that bonding/aggregation/merging is not possible in an active/active situation. So this doesn't improve our setup. greetz, Koen *** Disclaimer *** Vlaamse Radio- en Televisieomroep Auguste Reyerslaan 52, 1043 Brussel nv van publiek recht BTW BE 0244.142.664 RPR Brussel http://www.vrt.be/disclaimer __ ___ general mailing list [email protected] http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general ___ general mailing list [email protected] http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general ___ general mailing list [email protected] http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [ofa-general] oversubscription
On Tue, Mar 13, 2007 at 11:30:14PM +0100, SEGERS Koen wrote: > I'm trying to resolve an oversubscription problem of 1 server receiving > streams from 4 hosts. A host can only receive so fast, no matter how many IB cards you stuff into it. This is doubly so if you plan on doing something with all that data. Getting the routing tables right is the least of your worries. -- greg ___ general mailing list [email protected] http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [ofa-general] oversubscription
On Tue, 2007-03-13 at 17:30, SEGERS Koen wrote: > I'm trying to resolve an oversubscription problem of 1 server > receiving streams from 4 hosts. > > If you connect the server with 4 cables to the switch, it should be > resolved when I define the routes that should be used. But is it > possible to define the routing tables in the subnet manager? Depends on the SM as to whether this is supported or not. OpenSM supports the ability to do this as do some vendor SMs. > Maybe just running the fattree routing module is sufficient? I'm not sure; Yevgeny would be the best to answer this. > I also saw that it is possible to set the routes by using a file. Can > someone give an example of this? This capability is documented in the opensm man page. You can obtain this file via dump_lfts.sh script. > Currently I'm trying a combination of partitioning and linux routing. > Is this a good idea? What do you mean by Linux routing ? Is this IP routing ? -- Hal > BTW: we are only interested in SDP and IPoIB. In a previous thread I > discovered that bonding/aggregation/merging is not possible in an > active/active situation. So this doesn't improve our setup. > > greetz, > > Koen > *** Disclaimer *** > > Vlaamse Radio- en Televisieomroep > Auguste Reyerslaan 52, 1043 Brussel > > nv van publiek recht > BTW BE 0244.142.664 > RPR Brussel > http://www.vrt.be/disclaimer > > > > __ > > ___ > general mailing list > [email protected] > http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general > > To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general ___ general mailing list [email protected] http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [ofa-general] oversubscription
On Tue, 2007-03-13 at 17:30, SEGERS Koen wrote: > I'm trying to resolve an oversubscription problem of 1 server > receiving streams from 4 hosts. > > If you connect the server with 4 cables to the switch, it should be > resolved when I define the routes that should be used. But is it > possible to define the routing tables in the subnet manager? Maybe > just running the fattree routing module is sufficient? I also saw that > it is possible to set the routes by using a file. Can someone give an > example of this? > > Currently I'm trying a combination of partitioning and linux routing. > Is this a good idea? > > BTW: we are only interested in SDP and IPoIB. In a previous thread I > discovered that bonding/aggregation/merging is not possible in an > active/active situation. So this doesn't improve our setup. > > greetz, > > Koen > *** Disclaimer *** > > Vlaamse Radio- en Televisieomroep > Auguste Reyerslaan 52, 1043 Brussel > > nv van publiek recht > BTW BE 0244.142.664 > RPR Brussel > http://www.vrt.be/disclaimer > > > > __ > > ___ > general mailing list > [email protected] > http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general > > To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general ___ general mailing list [email protected] http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
