Re: [c-nsp] 10GE WAN options for 7606 for market data / micro-bursting
Another option is WS-6708 http://www.cisco.com/en/US/solutions/collateral/ns340/ns517/ns224/ns668/net_qanda0900aecd80534905.html -Azher Matthew Huff wrote: We are planning on moving a large portion of our data center to a colo facility at an financial exchange. We will be using redundant 10-GE connections from our existing pair of 7604 to a new pair of 7606 with Sup720-3B. We won't be doing MPLS/VPN, etc... Just normal L3 routing including PIM sparse mode multicast. Since a significant amount of the traffic will be market data, the line rate will be very bursty including micro-bursts. We will be setting up a series of LLQ queues with Modular QoS CLI and are interested in H-QOS, so I have some questions regarding which 10GB interface. The choices are: 1) WS-X6704-10GE. The standard linecard. TX queue of 1p7q8t. 16MB per port buffer 2) 7600-ES20-10G3C. TX queue ??? (configurable ???), buffer size ??? 3) 7600-SIP-600 with SPA-10X1GE. TX queue ???, buffer size ??? The SIP and ES20 may be overkill, maybe not. We aren't doing MPLS or VRF, or QinQ or any other tunneling, but we need the most flexible, best 10GB WAN interface that can help us deal with bursting/QOS. Any experiences, suggestions, warnings...? Matthew Huff | One Manhattanville Rd OTA Management LLC | Purchase, NY 10577 http://www.ox.com | Phone: 914-460-4039 aim: matthewbhuff | Fax: 914-460-4139 ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] 10GE WAN options for 7606 for market data / micro-bursting
The WS-X6704-10GE has: - Xenpacks - only 16MB buffers per port compared to 200MB on WS-X6708 - is about 5 years old. I remember this was the first 10G card we used in 6500 back in 2005/6 - traditionally targeted for LAN and DC segment with simple/none QoS - hence the QoS implementation is simple based on WRR - see http://www.cisco.com/en/US/docs/solutions/Enterprise/Video/tpqoscampus.html#wp1072698 - needs a DFC card for ingress 8q8t - see http://www.cisco.com/en/US/docs/solutions/Enterprise/Video/tpqoscampus.html#wp1072698 Therefore a much better alternative is WS-X6708 or even WS-X6716. However bare in mind that these are also LAN cards therefore might not suite your QoS needs. For general QoS architecture on C6500 see http://www.cisco.com/en/US/prod/collateral/switches/ps5718/ps708/prod_white_paper0900aecd803e5269.html. Cisco quickly found out that you cannot do much sophisticated stuff with cards above and came with ES product line for service provider segment - which is the ES20 and newer ES+ (http://www.cisco.com/en/US/docs/solutions/Enterprise/Video/tpqoscampus.html#wp1072698). Hope it helps, -Pavel On Fri, Jan 29, 2010 at 11:04 PM, Phil Bedard phil...@gmail.com wrote: The ES20 cards have 512MB, the SIP-600 has 256MB, but I think they both say 100ms unidirectional buffering... Is there a chance of congesting the egress interfaces where you would need the larger buffers? They all support LLQ for priority traffic. Phil On Jan 29, 2010, at 12:22 PM, Matthew Huff wrote: We are planning on moving a large portion of our data center to a colo facility at an financial exchange. We will be using redundant 10-GE connections from our existing pair of 7604 to a new pair of 7606 with Sup720-3B. We won't be doing MPLS/VPN, etc... Just normal L3 routing including PIM sparse mode multicast. Since a significant amount of the traffic will be market data, the line rate will be very bursty including micro-bursts. We will be setting up a series of LLQ queues with Modular QoS CLI and are interested in H-QOS, so I have some questions regarding which 10GB interface. The choices are: 1) WS-X6704-10GE. The standard linecard. TX queue of 1p7q8t. 16MB per port buffer 2) 7600-ES20-10G3C. TX queue ??? (configurable ???), buffer size ??? 3) 7600-SIP-600 with SPA-10X1GE. TX queue ???, buffer size ??? The SIP and ES20 may be overkill, maybe not. We aren't doing MPLS or VRF, or QinQ or any other tunneling, but we need the most flexible, best 10GB WAN interface that can help us deal with bursting/QOS. Any experiences, suggestions, warnings...? Matthew Huff | One Manhattanville Rd OTA Management LLC | Purchase, NY 10577 http://www.ox.com | Phone: 914-460-4039 aim: matthewbhuff | Fax: 914-460-4139 ___ cisco-nsp mailing list cisco-...@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-...@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] 10GE WAN options for 7606 for market data / micro-bursting
On 30 Jan 2010, at 17:59, Pavel Skovajsa wrote: Cisco quickly found out that you cannot do much sophisticated stuff with cards above and came with ES product line for service provider segment - which is the ES20 and newer ES+ (http://www.cisco.com/en/US/docs/solutions/Enterprise/Video/tpqoscampus.html#wp1072698). If you are going to spend the money on ES, a few words of warning about ES-20. It is very limited in terms of what the card can actually do in terms of QoS (for example, there's no tuneable Tc for any policy) - additionally, everything needs to be under a class-default on sub-interfaces for example. We found that this has severely limited a number of QoS deployments that we've tried to do. SIP-400 is actually better than ES-20 - I'd look at ES+20/ES+40 for your requirements. LAN cards don't seem the best way to go if you need such strict control. However, I'd put together a strict statement of requirements and get Cisco to demonstrate that the card meets your demands before you go forward. The 7600 platform can have a nasty habit of biting you back. I can probably share more details of the ES off-list if you need them! Cheers, Rob -- Rob Shakir r...@eng.gxn.net Network Development EngineerGX Networks/Vialtus Solutions ddi: +44208 587 6077mob: +44797 155 4098 pgp: 0xc07e6deb nic-hdl: RJS-RIPE This email is subject to: http://www.vialtus.com/disclaimer.html ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] 10GE WAN options for 7606 for market data / micro-bursting
Thanks. I had missed the ES+ line cards since they are a bit obscured on the main web page of the 7600. I'm definitely going to run everything by/through cisco, but my experience is that if you don't know enough to ask the right questions, you end up with whatever hardware they are pushing that quarter. -Original Message- From: Rob Shakir [mailto:r...@eng.gxn.net] Sent: Saturday, January 30, 2010 5:05 PM To: Matthew Huff Cc: cisco-nsp@puck.nether.net Subject: Re: [c-nsp] 10GE WAN options for 7606 for market data / micro-bursting On 30 Jan 2010, at 17:59, Pavel Skovajsa wrote: Cisco quickly found out that you cannot do much sophisticated stuff with cards above and came with ES product line for service provider segment - which is the ES20 and newer ES+ (http://www.cisco.com/en/US/docs/solutions/Enterprise/Video/tpqoscampus.html#wp1072698). If you are going to spend the money on ES, a few words of warning about ES-20. It is very limited in terms of what the card can actually do in terms of QoS (for example, there's no tuneable Tc for any policy) - additionally, everything needs to be under a class-default on sub-interfaces for example. We found that this has severely limited a number of QoS deployments that we've tried to do. SIP-400 is actually better than ES-20 - I'd look at ES+20/ES+40 for your requirements. LAN cards don't seem the best way to go if you need such strict control. However, I'd put together a strict statement of requirements and get Cisco to demonstrate that the card meets your demands before you go forward. The 7600 platform can have a nasty habit of biting you back. I can probably share more details of the ES off-list if you need them! Cheers, Rob -- Rob Shakir r...@eng.gxn.net Network Development EngineerGX Networks/Vialtus Solutions ddi: +44208 587 6077mob: +44797 155 4098 pgp: 0xc07e6deb nic-hdl: RJS-RIPE This email is subject to: http://www.vialtus.com/disclaimer.html ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
[c-nsp] 10GE WAN options for 7606 for market data / micro-bursting
We are planning on moving a large portion of our data center to a colo facility at an financial exchange. We will be using redundant 10-GE connections from our existing pair of 7604 to a new pair of 7606 with Sup720-3B. We won't be doing MPLS/VPN, etc... Just normal L3 routing including PIM sparse mode multicast. Since a significant amount of the traffic will be market data, the line rate will be very bursty including micro-bursts. We will be setting up a series of LLQ queues with Modular QoS CLI and are interested in H-QOS, so I have some questions regarding which 10GB interface. The choices are: 1) WS-X6704-10GE. The standard linecard. TX queue of 1p7q8t. 16MB per port buffer 2) 7600-ES20-10G3C. TX queue ??? (configurable ???), buffer size ??? 3) 7600-SIP-600 with SPA-10X1GE. TX queue ???, buffer size ??? The SIP and ES20 may be overkill, maybe not. We aren't doing MPLS or VRF, or QinQ or any other tunneling, but we need the most flexible, best 10GB WAN interface that can help us deal with bursting/QOS. Any experiences, suggestions, warnings...? Matthew Huff | One Manhattanville Rd OTA Management LLC | Purchase, NY 10577 http://www.ox.com | Phone: 914-460-4039 aim: matthewbhuff | Fax: 914-460-4139 ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] 10GE WAN options for 7606 for market data / micro-bursting
On Fri, 29 Jan 2010, Matthew Huff wrote:
1) WS-X6704-10GE. The standard linecard. TX queue of 1p7q8t. 16MB per port
buffer
If it's bursty you may want to consider 6708 instead. It has bigger
buffers.
-
typedef struct me_s {
char name[] = { Thomas Habets };
char email[] = { tho...@habets.pp.se };
char kernel[]= { Linux };
char *pgpKey[] = { http://www.habets.pp.se/pubkey.txt; };
char pgp[] = { A8A3 D1DD 4AE0 8467 7FDE 0945 286A E90A AD48 E854 };
char coolcmd[] = { echo '. ./_. ./_'_;. ./_ };
} me_t;
___
cisco-nsp mailing list cisco-nsp@puck.nether.net
https://puck.nether.net/mailman/listinfo/cisco-nsp
archive at http://puck.nether.net/pipermail/cisco-nsp/
Re: [c-nsp] 10GE WAN options for 7606 for market data / micro-bursting
The ES20 cards have 512MB, the SIP-600 has 256MB, but I think they both say 100ms unidirectional buffering... Is there a chance of congesting the egress interfaces where you would need the larger buffers? They all support LLQ for priority traffic. Phil On Jan 29, 2010, at 12:22 PM, Matthew Huff wrote: We are planning on moving a large portion of our data center to a colo facility at an financial exchange. We will be using redundant 10-GE connections from our existing pair of 7604 to a new pair of 7606 with Sup720-3B. We won't be doing MPLS/VPN, etc... Just normal L3 routing including PIM sparse mode multicast. Since a significant amount of the traffic will be market data, the line rate will be very bursty including micro-bursts. We will be setting up a series of LLQ queues with Modular QoS CLI and are interested in H-QOS, so I have some questions regarding which 10GB interface. The choices are: 1) WS-X6704-10GE. The standard linecard. TX queue of 1p7q8t. 16MB per port buffer 2) 7600-ES20-10G3C. TX queue ??? (configurable ???), buffer size ??? 3) 7600-SIP-600 with SPA-10X1GE. TX queue ???, buffer size ??? The SIP and ES20 may be overkill, maybe not. We aren't doing MPLS or VRF, or QinQ or any other tunneling, but we need the most flexible, best 10GB WAN interface that can help us deal with bursting/QOS. Any experiences, suggestions, warnings...? Matthew Huff | One Manhattanville Rd OTA Management LLC | Purchase, NY 10577 http://www.ox.com | Phone: 914-460-4039 aim: matthewbhuff | Fax: 914-460-4139 ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/ ___ cisco-nsp mailing list cisco-nsp@puck.nether.net https://puck.nether.net/mailman/listinfo/cisco-nsp archive at http://puck.nether.net/pipermail/cisco-nsp/
