Re: RTG
On 10/30/19 10:10 PM, Seth Mattinen wrote: On 10/30/19 6:13 AM, John Von Essen wrote: I too love RTG, been using it forever, appears to handle interfaces all the way up 10G. I still use RTG. Not for graphing or anything fancy, just for polling counters in a database to be queried by other things. It's still useful for raw numbers for billing. Slight correction, I'm using rtg2: https://code.google.com/archive/p/rtg2/downloads
Re: RTG
On 10/30/19 6:13 AM, John Von Essen wrote: I too love RTG, been using it forever, appears to handle interfaces all the way up 10G. I still use RTG. Not for graphing or anything fancy, just for polling counters in a database to be queried by other things. It's still useful for raw numbers for billing.
RE: RTG
Hi Nick, At the time MRTG was the thing that everyone was using and the way it handled numbers and how it stored those numbers made it challenging to use for our use case. The things that we like about RTG are that it collects raw (non-smoothed) numbers (usage) and it stores those numbers in a well known RDBMS. This has made it extremely easy to integrate that data in other applications and with other data sources such as sflow/netflow to do some interesting things. It is also very easy to include graphs generated by RTG in other applications. The primary pain point is how it handles 'targets' for polling and the targetmaker script itself. I will check out Libre. Thanks! -Drew -Original Message- From: Nick Hilliard Sent: Wednesday, October 30, 2019 9:09 AM To: Drew Weaver Cc: 'nanog@nanog.org' Subject: Re: RTG Drew Weaver wrote on 30/10/2019 12:25: > We've been using this product for years and years > http://rtg.sourceforge.net/ to collect and store SNMP statistics. > > It has been working fine for us. I haven't really been able to find > much information about forks, new versions, and development happening on it. > > A while back I heard that Yahoo created their own version of it but I > could never find it. that would have been yrtg: http://mu.org/~billf/yrtg/ > Does anyone know if there is a spiritual successor to RTG that pretty > much works the same way that is modernized? It was ok at the time, in its own way, but there are lots of other options these days, ranging from librenms to graphite, prometheus and that end of things, depending on what you're looking for in a graphing package. Things moved on a bit in the area. Nick
Re: RTG
I too love RTG, been using it forever, appears to handle interfaces all the way up 10G. Out of curiosity, are you hitting an issue that requires updating? I get it, there are many options now, but back in the day, RTG was so simple and so useful, its a testament to the original product. Its a great light weight traffic monitor, at my old datacenter I monitored over 2000 interfaces (with up to 2 years of retention) from a very basic low-end single CPU box. -John > On Oct 30, 2019, at 8:25 AM, Drew Weaver wrote: > > Hello, > > We’ve been using this product for years and years http://rtg.sourceforge.net/ > <http://rtg.sourceforge.net/> to collect and store SNMP statistics. > > It has been working fine for us. I haven’t really been able to find much > information about forks, new versions, and development happening on it. > > A while back I heard that Yahoo created their own version of it but I could > never find it. > > Does anyone know if there is a spiritual successor to RTG that pretty much > works the same way that is modernized? > > Thanks! > -Drew
Re: RTG
Drew Weaver wrote on 30/10/2019 12:25: We’ve been using this product for years and years http://rtg.sourceforge.net/ to collect and store SNMP statistics. It has been working fine for us. I haven’t really been able to find much information about forks, new versions, and development happening on it. A while back I heard that Yahoo created their own version of it but I could never find it. that would have been yrtg: http://mu.org/~billf/yrtg/ Does anyone know if there is a spiritual successor to RTG that pretty much works the same way that is modernized? It was ok at the time, in its own way, but there are lots of other options these days, ranging from librenms to graphite, prometheus and that end of things, depending on what you're looking for in a graphing package. Things moved on a bit in the area. Nick
RTG
Hello, We've been using this product for years and years http://rtg.sourceforge.net/ to collect and store SNMP statistics. It has been working fine for us. I haven't really been able to find much information about forks, new versions, and development happening on it. A while back I heard that Yahoo created their own version of it but I could never find it. Does anyone know if there is a spiritual successor to RTG that pretty much works the same way that is modernized? Thanks! -Drew
Re: collectd as alternative to RTG for high-resolution polling and long term storage?
Collectd is great, IMHO. I was using collectd+graphite to gather and display stats for a large collection of VMs, servers, routers, and switches. Collectd itself was pretty low overhead, easy to configure (I managed configs via puppet) and Just Worked. Graphite and carbon cache were a little more tricky to set up - carbon by default aggregates/averages older data, so if not setup correctly, when you go back a few months and try to drill into a graph at a 5 minute interval, you get unexpected results. I’d highly recommend looking at Graphite, as well. Once you get used to it, being able to apply functions[1] to aggregate, manipulate, and quickly find patterns in data is super useful (ex: look at all interfaces on this switch, only display graphs for the top 5 abnormal traffic). Jason Dixon has written some great blogs posts about it’s use on obfuscurity.com. John 1: https://graphite.readthedocs.org/en/latest/functions.html > On Mar 16, 2016, at 11:45 AM, Eric Kuhnke <eric.kuh...@gmail.com> wrote: > > Would anyone care to share their experience using collectd as an > alternative to rtg for high-resolution polling of interface traffic and > long term storage? > > I am investigating the various options for large data set size, lossless > long term traffic charting (not RRAs which lose precision over time). One > possible use is precision 95th billing. > > https://collectd.org/
Re: collectd as alternative to RTG for high-resolution polling and long term storage?
Prometheus is also worth taking a look at. http://prometheus.io/docs/introduction/comparison/ *[image: userimage]Scott Larson[image: los angeles] <https://www.google.com/maps/place/4216+Glencoe+Ave,+Marina+Del+Rey,+CA+90292/@33.9892151,-118.4421334,17z/data=!3m1!4b1!4m2!3m1!1s0x80c2ba88ffae914d:0x14e1d00084d4d09c>Lead Systems Administrator[image: wdlogo] <https://www.wiredrive.com/> [image: linkedin] <https://www.linkedin.com/company/wiredrive> [image: facebook] <https://www.twitter.com/wiredrive> [image: twitter] <https://www.facebook.com/wiredrive> [image: instagram] <https://www.instagram.com/wiredrive>T 310 823 8238 x1106 <310%20823%208238%20x1106> | M 310 904 8818 <310%20904%208818>* On Wed, Mar 16, 2016 at 5:52 PM, Peter Phaal <peter.ph...@gmail.com> wrote: > On Wed, Mar 16, 2016 at 11:45 AM, Eric Kuhnke <eric.kuh...@gmail.com> > wrote: > > Would anyone care to share their experience using collectd as an > > alternative to rtg for high-resolution polling of interface traffic and > > long term storage? > > > > I am investigating the various options for large data set size, lossless > > long term traffic charting (not RRAs which lose precision over time). One > > possible use is precision 95th billing. > > > > https://collectd.org/ > > Devices that support sFlow natively implement collectd type > functionality for streaming interface counters to a time series > database (InfluxDB, Graphite, OpenTSB, etc.) Tools like Grafana can be > used to query the database and build dashboards. > > Host sFlow (http://sflow.net) is very similar to collectd in the > metrics it exports, but with the added ability to export flow data > from host adapters, bridges, vSwitches, firewalls, routing, VMs, > containers etc. >
Re: collectd as alternative to RTG for high-resolution polling and long term storage?
On Mar 16, 2016, at 11:45 AM, Eric Kuhnke <eric.kuh...@gmail.com> wrote: > > Would anyone care to share their experience using collectd as an > alternative to rtg for high-resolution polling of interface traffic and > long term storage? > > I am investigating the various options for large data set size, lossless > long term traffic charting (not RRAs which lose precision over time). One > possible use is precision 95th billing. > > https://collectd.org/ Correct me if I’m wrong, but I believe that collectd uses RRD files for the backend, which you said you don’t want. You might check out Grafana (http://grafana.org/ <http://grafana.org/>). Its based off graphite and uses something like opentsdb or influxdb for the backend. I think this is probably more what you’re looking for. -- Louis Kowolowskilou...@cryptomonkeys.org <mailto:lou...@cryptomonkeys.org> Cryptomonkeys: http://www.cryptomonkeys.com/ <http://www.cryptomonkeys.com/> Making life more interesting for people since 1977 signature.asc Description: Message signed with OpenPGP using GPGMail
Re: collectd as alternative to RTG for high-resolution polling and long term storage?
Thus spake Eric Kuhnke (eric.kuh...@gmail.com) on Wed, Mar 16, 2016 at 11:45:26AM -0700: > Would anyone care to share their experience using collectd as an > alternative to rtg for high-resolution polling of interface traffic and > long term storage? > > I am investigating the various options for large data set size, lossless > long term traffic charting (not RRAs which lose precision over time). No, the storage interval is configurable and so are the (optional) consolidation functions. You may want to look tuning at the defaults your application is choosing. Dale
Re: collectd as alternative to RTG for high-resolution polling and long term storage?
Collectd supports a large number “write” plugins[1] that can write out to various sources. I had been eyeing Grafana and OpenTSDB, they’re probably worth a look John 1: https://collectd.org/wiki/index.php/Table_of_Plugins > On Mar 16, 2016, at 12:35 PM, Louis Kowolowski <lou...@cryptomonkeys.org> > wrote: > > On Mar 16, 2016, at 11:45 AM, Eric Kuhnke <eric.kuh...@gmail.com> wrote: >> >> Would anyone care to share their experience using collectd as an >> alternative to rtg for high-resolution polling of interface traffic and >> long term storage? >> >> I am investigating the various options for large data set size, lossless >> long term traffic charting (not RRAs which lose precision over time). One >> possible use is precision 95th billing. >> >> https://collectd.org/ > > > Correct me if I’m wrong, but I believe that collectd uses RRD files for the > backend, which you said you don’t want. > > You might check out Grafana (http://grafana.org/ <http://grafana.org/>). Its > based off graphite and uses something like opentsdb or influxdb for the > backend. I think this is probably more what you’re looking for. > > -- > Louis Kowolowskilou...@cryptomonkeys.org > <mailto:lou...@cryptomonkeys.org> > Cryptomonkeys: > http://www.cryptomonkeys.com/ <http://www.cryptomonkeys.com/> > > Making life more interesting for people since 1977 >
Re: collectd as alternative to RTG for high-resolution polling and long term storage?
On Wed, Mar 16, 2016 at 11:45 AM, Eric Kuhnke <eric.kuh...@gmail.com> wrote: > Would anyone care to share their experience using collectd as an > alternative to rtg for high-resolution polling of interface traffic and > long term storage? > > I am investigating the various options for large data set size, lossless > long term traffic charting (not RRAs which lose precision over time). One > possible use is precision 95th billing. > > https://collectd.org/ Devices that support sFlow natively implement collectd type functionality for streaming interface counters to a time series database (InfluxDB, Graphite, OpenTSB, etc.) Tools like Grafana can be used to query the database and build dashboards. Host sFlow (http://sflow.net) is very similar to collectd in the metrics it exports, but with the added ability to export flow data from host adapters, bridges, vSwitches, firewalls, routing, VMs, containers etc.
Re: collectd as alternative to RTG for high-resolution polling and long term storage?
Be aware that collectd itself is a collection agent. It doesn't include (last I checked) a grapher. There are however a number of graphers out there to work with those RRD files, if you use that to store the data. I personally have been using collectd across hundreds of Linux systems, using rrdcached to a central collector and wrote my own grapher for that stuff I am interested int. Ulf. On Wed, Mar 16, 2016 at 11:45 AM, Eric Kuhnke <eric.kuh...@gmail.com> wrote: > Would anyone care to share their experience using collectd as an > alternative to rtg for high-resolution polling of interface traffic and > long term storage? > > I am investigating the various options for large data set size, lossless > long term traffic charting (not RRAs which lose precision over time). One > possible use is precision 95th billing. > > https://collectd.org/ > -- Ulf Zimmermann, 1525 Pacific Ave., Alameda, CA-94501, #: 510-396-1764 You can find my resume at: http://www.Alameda.net/~ulf/resume.html
collectd as alternative to RTG for high-resolution polling and long term storage?
Would anyone care to share their experience using collectd as an alternative to rtg for high-resolution polling of interface traffic and long term storage? I am investigating the various options for large data set size, lossless long term traffic charting (not RRAs which lose precision over time). One possible use is precision 95th billing. https://collectd.org/