Re: [Vyatta-users] Want to use Vyatta for our main BGP router - butwhat about traffic tracking?
I know it's common to export Netflow graphs for billing purposes, however at my current company we use SNMP data gathered from our distribution switches for billing/monitoring purposes. If for some reason you encounter difficulty getting a NetFlow substitute working, or don't want to tack extra packages onto the OFR this might be a decent solution. Just my two cents, Nick On Nov 7, 2007 12:02 PM, Robert Bays [EMAIL PROTECTED] wrote: Dominic, You might want to take a look at the NetraMet package by CAIDA. It should be fairly easy to compile it and add it to an installed Vyatta router. http://www.caida.org/tools/measurement/netramet/dist.xml Another visualization tool that might help is flowscan. I don't know if it is compatible with fprobe or not but it's worth a look. See http://www.caida.org/tools/utilities/flowscan/ Cheers, Robert. Dominic Williams wrote: Many thanks for your response. What we need to generate is a traffic graph for each IP that we serve i.e. At 4.20.00pm some IP was using 7Mbps, at 4.20.15pm it was using 5.2Mbps, at 4.20.30 it was using 6.3Mbps and so on. We need this data is used to understand how sites (which run on IPs) behave and also to provision overall bandwidth and pass bandwidth costs to clients. Is this possible and for example, is anyone doing 95th percentile billing using a Vyatta router? Best, Dominic -Original Message- From: Holtz,Robert [EMAIL PROTECTED] To: Dominic Williams [EMAIL PROTECTED]; [EMAIL PROTECTED] [EMAIL PROTECTED] Sent: 07/11/07 16:27 Subject: RE: [Vyatta-users] Want to use Vyatta for our main BGP router - butwhat about traffic tracking? You can collect SNMP interface performance data anywhere along the path to the outside world, not just the router. There's quite a bit of flexibility. Examples: The Web Server itself Load Balancer, if you have a bunch of web servers Ethernet Switch(s) Router Etc. If you are not the intended recipient of this message (including attachments), or if you have received this message in error, immediately notify us and delete it and any attachments. If you no longer wish to receive e-mail from Edward Jones, please send this request to [EMAIL PROTECTED] You must include the e-mail address that you wish not to receive e-mail communications. For important additional information related to this e-mail, visit www.edwardjones.com/US_email_disclosure -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Dominic Williams Sent: Wednesday, November 07, 2007 10:07 AM To: [EMAIL PROTECTED] Subject: [Vyatta-users] Want to use Vyatta for our main BGP router - butwhat about traffic tracking? Hello all, My company is very keen to try a Vyatta solution, as we are about to move our hosting rack to a BGP solution and a 7204VXR with 1GB seems inordinately expensive!! But... we need to be able to monitor and track bandwidth to each individual IP address that we serve. This is a crucial requirement, as it is for many people involved in Web hosting. At the moment we just use Netflow exports from our Cisco router in conjunction with some tracking software... I know that Vyatta doesn't support Neflow, but somebody indicated on this list that you can get at these stats using SNMP. Is this really the case? Can you get at traffic flows for individual IPs that are being served through the router? -- I was under the impression SNMP was just of use for monitoring the status of a particular device / interface etc?? Many thanks for any advice you can give. Best, Dominic Dominic Williams www.System7.com www.Wyki.com Better Digital Publishing Email [EMAIL PROTECTED] Direct +44 (0) 203 0519110 ext. 8010 Mobile +44 (0) 7710 469456 Fax +44 (0) 8700 607555 Terms: This e-mail contains proprietary information some or all of which may be legally privileged. It is intended for the recipient only. If an addressing error or transmission error has misdirected this e-mail, please notify the sender immediately or contact [EMAIL PROTECTED] If you are not the intended recipient you must not use, disclose, distribute, copy, print or rely on this e-mail. ___ Vyatta-users mailing list Vyatta-users@mailman.vyatta.com http://mailman.vyatta.com/mailman/listinfo/vyatta-users ___ Vyatta-users mailing list Vyatta-users@mailman.vyatta.com http://mailman.vyatta.com/mailman/listinfo/vyatta-users ___ Vyatta-users mailing list Vyatta-users@mailman.vyatta.com http://mailman.vyatta.com/mailman/listinfo/vyatta-users ___ Vyatta-users mailing list Vyatta-users@mailman.vyatta.com http
Re: [Vyatta-users] Want to use Vyatta for our main BGP router - butwhat about traffic tracking?
Many thanks for your response. What we need to generate is a traffic graph for each IP that we serve i.e. At 4.20.00pm some IP was using 7Mbps, at 4.20.15pm it was using 5.2Mbps, at 4.20.30 it was using 6.3Mbps and so on. We need this data is used to understand how sites (which run on IPs) behave and also to provision overall bandwidth and pass bandwidth costs to clients. Is this possible and for example, is anyone doing 95th percentile billing using a Vyatta router? Best, Dominic -Original Message- From: Holtz,Robert [EMAIL PROTECTED] To: Dominic Williams [EMAIL PROTECTED]; [EMAIL PROTECTED] [EMAIL PROTECTED] Sent: 07/11/07 16:27 Subject: RE: [Vyatta-users] Want to use Vyatta for our main BGP router - butwhat about traffic tracking? You can collect SNMP interface performance data anywhere along the path to the outside world, not just the router. There's quite a bit of flexibility. Examples: The Web Server itself Load Balancer, if you have a bunch of web servers Ethernet Switch(s) Router Etc. If you are not the intended recipient of this message (including attachments), or if you have received this message in error, immediately notify us and delete it and any attachments. If you no longer wish to receive e-mail from Edward Jones, please send this request to [EMAIL PROTECTED] You must include the e-mail address that you wish not to receive e-mail communications. For important additional information related to this e-mail, visit www.edwardjones.com/US_email_disclosure -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Dominic Williams Sent: Wednesday, November 07, 2007 10:07 AM To: [EMAIL PROTECTED] Subject: [Vyatta-users] Want to use Vyatta for our main BGP router - butwhat about traffic tracking? Hello all, My company is very keen to try a Vyatta solution, as we are about to move our hosting rack to a BGP solution and a 7204VXR with 1GB seems inordinately expensive!! But... we need to be able to monitor and track bandwidth to each individual IP address that we serve. This is a crucial requirement, as it is for many people involved in Web hosting. At the moment we just use Netflow exports from our Cisco router in conjunction with some tracking software... I know that Vyatta doesn't support Neflow, but somebody indicated on this list that you can get at these stats using SNMP. Is this really the case? Can you get at traffic flows for individual IPs that are being served through the router? -- I was under the impression SNMP was just of use for monitoring the status of a particular device / interface etc?? Many thanks for any advice you can give. Best, Dominic Dominic Williams www.System7.com www.Wyki.com Better Digital Publishing Email [EMAIL PROTECTED] Direct +44 (0) 203 0519110 ext. 8010 Mobile +44 (0) 7710 469456 Fax +44 (0) 8700 607555 Terms: This e-mail contains proprietary information some or all of which may be legally privileged. It is intended for the recipient only. If an addressing error or transmission error has misdirected this e-mail, please notify the sender immediately or contact [EMAIL PROTECTED] If you are not the intended recipient you must not use, disclose, distribute, copy, print or rely on this e-mail. ___ Vyatta-users mailing list Vyatta-users@mailman.vyatta.com http://mailman.vyatta.com/mailman/listinfo/vyatta-users ___ Vyatta-users mailing list Vyatta-users@mailman.vyatta.com http://mailman.vyatta.com/mailman/listinfo/vyatta-users
Re: [Vyatta-users] Want to use Vyatta for our main BGP router - butwhat about traffic tracking?
This sounds very interesting. Have you noticed any performance impact to running it? -- Aubrey Wells Senior Engineer Shelton | Johns Technology Group A Vyatta Ready Partner www.sheltonjohns.com On Nov 7, 2007, at 10:15 PM, Alain Kelder wrote: Hello Dominic, Out of the various tools I've tried, netacct-mysql is currently my favorite. It collects bandwidth data through libpcap and stores in a MySQL DB. It comes with a PHP front end, but to me the real power is that it stores the stats in MySQL. Through SQL SELECT statements, I'm able to get all the stats I need. For instance: mysql SELECT SUM((input+output)/1073741824) FROM traffic WHERE IP='10.10.2.122' AND time LIKE '2007-09%'; gives me total (in+out) GBs of bandwith used by 10.10.2.122 during Sept 07. I run it on the Xen host to keep track of the guest domain bandwidth usage, but it should run on the Vyatta box just as well (haven't tried yet, sorry). The other thing I started playing with today is grabbing the data from the DB using PHP and feeding it to the chart PHP script from www.maani.us to get pretty graphs. I would love to know what you end up using! Cheers, -Alain. http://sourceforge.net/projects/netacct-mysql/ Dominic Williams wrote: Many thanks for your response. What we need to generate is a traffic graph for each IP that we serve i.e. At 4.20.00pm some IP was using 7Mbps, at 4.20.15pm it was using 5.2Mbps, at 4.20.30 it was using 6.3Mbps and so on. We need this data is used to understand how sites (which run on IPs) behave and also to provision overall bandwidth and pass bandwidth costs to clients. Is this possible and for example, is anyone doing 95th percentile billing using a Vyatta router? Best, Dominic -Original Message- From: Holtz,Robert [EMAIL PROTECTED] To: Dominic Williams [EMAIL PROTECTED]; vyatta- [EMAIL PROTECTED] [EMAIL PROTECTED] Sent: 07/11/07 16:27 Subject: RE: [Vyatta-users] Want to use Vyatta for our main BGP router - butwhat about traffic tracking? You can collect SNMP interface performance data anywhere along the path to the outside world, not just the router. There's quite a bit of flexibility. Examples: The Web Server itself Load Balancer, if you have a bunch of web servers Ethernet Switch(s) Router Etc. If you are not the intended recipient of this message (including attachments), or if you have received this message in error, immediately notify us and delete it and any attachments. If you no longer wish to receive e-mail from Edward Jones, please send this request to [EMAIL PROTECTED] You must include the e- mail address that you wish not to receive e-mail communications. For important additional information related to this e-mail, visit www.edwardjones.com/US_email_disclosure -Original Message- From: [EMAIL PROTECTED] [mailto:vyatta-users- [EMAIL PROTECTED] On Behalf Of Dominic Williams Sent: Wednesday, November 07, 2007 10:07 AM To: [EMAIL PROTECTED] Subject: [Vyatta-users] Want to use Vyatta for our main BGP router - butwhat about traffic tracking? Hello all, My company is very keen to try a Vyatta solution, as we are about to move our hosting rack to a BGP solution and a 7204VXR with 1GB seems inordinately expensive!! But... we need to be able to monitor and track bandwidth to each individual IP address that we serve. This is a crucial requirement, as it is for many people involved in Web hosting. At the moment we just use Netflow exports from our Cisco router in conjunction with some tracking software... I know that Vyatta doesn't support Neflow, but somebody indicated on this list that you can get at these stats using SNMP. Is this really the case? Can you get at traffic flows for individual IPs that are being served through the router? -- I was under the impression SNMP was just of use for monitoring the status of a particular device / interface etc?? Many thanks for any advice you can give. Best, Dominic Dominic Williams www.System7.com www.Wyki.com Better Digital Publishing Email [EMAIL PROTECTED] Direct +44 (0) 203 0519110 ext. 8010 Mobile +44 (0) 7710 469456 Fax +44 (0) 8700 607555 Terms: This e-mail contains proprietary information some or all of which may be legally privileged. It is intended for the recipient only. If an addressing error or transmission error has misdirected this e-mail, please notify the sender immediately or contact [EMAIL PROTECTED] If you are not the intended recipient you must not use, disclose, distribute, copy, print or rely on this e-mail. ___ Vyatta-users mailing list Vyatta-users@mailman.vyatta.com http://mailman.vyatta.com/mailman/listinfo/vyatta-users ___ Vyatta-users mailing list Vyatta-users@mailman.vyatta.com http
Re: [Vyatta-users] Want to use Vyatta for our main BGP router - butwhat about traffic tracking?
Hello Dominic, Out of the various tools I've tried, netacct-mysql is currently my favorite. It collects bandwidth data through libpcap and stores in a MySQL DB. It comes with a PHP front end, but to me the real power is that it stores the stats in MySQL. Through SQL SELECT statements, I'm able to get all the stats I need. For instance: mysql SELECT SUM((input+output)/1073741824) FROM traffic WHERE IP='10.10.2.122' AND time LIKE '2007-09%'; gives me total (in+out) GBs of bandwith used by 10.10.2.122 during Sept 07. I run it on the Xen host to keep track of the guest domain bandwidth usage, but it should run on the Vyatta box just as well (haven't tried yet, sorry). The other thing I started playing with today is grabbing the data from the DB using PHP and feeding it to the chart PHP script from www.maani.us to get pretty graphs. I would love to know what you end up using! Cheers, -Alain. http://sourceforge.net/projects/netacct-mysql/ Dominic Williams wrote: Many thanks for your response. What we need to generate is a traffic graph for each IP that we serve i.e. At 4.20.00pm some IP was using 7Mbps, at 4.20.15pm it was using 5.2Mbps, at 4.20.30 it was using 6.3Mbps and so on. We need this data is used to understand how sites (which run on IPs) behave and also to provision overall bandwidth and pass bandwidth costs to clients. Is this possible and for example, is anyone doing 95th percentile billing using a Vyatta router? Best, Dominic -Original Message- From: Holtz,Robert [EMAIL PROTECTED] To: Dominic Williams [EMAIL PROTECTED]; [EMAIL PROTECTED] [EMAIL PROTECTED] Sent: 07/11/07 16:27 Subject: RE: [Vyatta-users] Want to use Vyatta for our main BGP router - butwhat about traffic tracking? You can collect SNMP interface performance data anywhere along the path to the outside world, not just the router. There's quite a bit of flexibility. Examples: The Web Server itself Load Balancer, if you have a bunch of web servers Ethernet Switch(s) Router Etc. If you are not the intended recipient of this message (including attachments), or if you have received this message in error, immediately notify us and delete it and any attachments. If you no longer wish to receive e-mail from Edward Jones, please send this request to [EMAIL PROTECTED] You must include the e-mail address that you wish not to receive e-mail communications. For important additional information related to this e-mail, visit www.edwardjones.com/US_email_disclosure -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Dominic Williams Sent: Wednesday, November 07, 2007 10:07 AM To: [EMAIL PROTECTED] Subject: [Vyatta-users] Want to use Vyatta for our main BGP router - butwhat about traffic tracking? Hello all, My company is very keen to try a Vyatta solution, as we are about to move our hosting rack to a BGP solution and a 7204VXR with 1GB seems inordinately expensive!! But... we need to be able to monitor and track bandwidth to each individual IP address that we serve. This is a crucial requirement, as it is for many people involved in Web hosting. At the moment we just use Netflow exports from our Cisco router in conjunction with some tracking software... I know that Vyatta doesn't support Neflow, but somebody indicated on this list that you can get at these stats using SNMP. Is this really the case? Can you get at traffic flows for individual IPs that are being served through the router? -- I was under the impression SNMP was just of use for monitoring the status of a particular device / interface etc?? Many thanks for any advice you can give. Best, Dominic Dominic Williams www.System7.com www.Wyki.com Better Digital Publishing Email [EMAIL PROTECTED] Direct +44 (0) 203 0519110 ext. 8010 Mobile +44 (0) 7710 469456 Fax +44 (0) 8700 607555 Terms: This e-mail contains proprietary information some or all of which may be legally privileged. It is intended for the recipient only. If an addressing error or transmission error has misdirected this e-mail, please notify the sender immediately or contact [EMAIL PROTECTED] If you are not the intended recipient you must not use, disclose, distribute, copy, print or rely on this e-mail. ___ Vyatta-users mailing list Vyatta-users@mailman.vyatta.com http://mailman.vyatta.com/mailman/listinfo/vyatta-users ___ Vyatta-users mailing list Vyatta-users@mailman.vyatta.com http://mailman.vyatta.com/mailman/listinfo/vyatta-users
