Re: RTG

2019-10-30 Thread Seth Mattinen

On 10/30/19 10:10 PM, Seth Mattinen wrote:

On 10/30/19 6:13 AM, John Von Essen wrote:
I too love RTG, been using it forever, appears to handle interfaces 
all the way up 10G.





I still use RTG. Not for graphing or anything fancy, just for polling 
counters in a database to be queried by other things. It's still useful 
for raw numbers for billing.



Slight correction, I'm using rtg2:
https://code.google.com/archive/p/rtg2/downloads


Re: RTG

2019-10-30 Thread Seth Mattinen

On 10/30/19 6:13 AM, John Von Essen wrote:
I too love RTG, been using it forever, appears to handle interfaces all 
the way up 10G.





I still use RTG. Not for graphing or anything fancy, just for polling 
counters in a database to be queried by other things. It's still useful 
for raw numbers for billing.


RE: RTG

2019-10-30 Thread Drew Weaver
Hi Nick,

At the time MRTG was the thing that everyone was using and the way it handled 
numbers and how it stored those numbers made it challenging to use for our use 
case.

The things that we like about RTG are that it collects raw (non-smoothed) 
numbers (usage) and it stores those numbers in a well known RDBMS.

This has made it extremely easy to integrate that data in other applications 
and with other data sources such as sflow/netflow to do some interesting things.

 It is also very easy to include graphs generated by RTG in other applications.

The primary pain point is how it handles 'targets' for polling and the 
targetmaker script itself. 

I will check out Libre.
Thanks!
-Drew




-Original Message-
From: Nick Hilliard  
Sent: Wednesday, October 30, 2019 9:09 AM
To: Drew Weaver 
Cc: 'nanog@nanog.org' 
Subject: Re: RTG

Drew Weaver wrote on 30/10/2019 12:25:
> We've been using this product for years and years 
> http://rtg.sourceforge.net/ to collect and store SNMP statistics.
> 
> It has been working fine for us. I haven't really been able to find 
> much information about forks, new versions, and development happening on it.
> 
> A while back I heard that Yahoo created their own version of it but I 
> could never find it.

that would have been yrtg:

http://mu.org/~billf/yrtg/

> Does anyone know if there is a spiritual successor to RTG that pretty 
> much works the same way that is modernized?

It was ok at the time, in its own way, but there are lots of other options 
these days, ranging from librenms to graphite, prometheus and that end of 
things, depending on what you're looking for in a graphing package.  Things 
moved on a bit in the area.

Nick



Re: RTG

2019-10-30 Thread John Von Essen
I too love RTG, been using it forever, appears to handle interfaces all the way 
up 10G.

Out of curiosity, are you hitting an issue that requires updating?

I get it, there are many options now, but back in the day, RTG was so simple 
and so useful, its a testament to the original product. Its a great light 
weight traffic monitor, at my old datacenter I monitored over 2000 interfaces 
(with up to 2 years of retention) from a very basic low-end single CPU box.

-John

> On Oct 30, 2019, at 8:25 AM, Drew Weaver  wrote:
> 
> Hello,
>  
> We’ve been using this product for years and years http://rtg.sourceforge.net/ 
> <http://rtg.sourceforge.net/> to collect and store SNMP statistics.
>  
> It has been working fine for us. I haven’t really been able to find much 
> information about forks, new versions, and development happening on it.
>  
> A while back I heard that Yahoo created their own version of it but I could 
> never find it.
>  
> Does anyone know if there is a spiritual successor to RTG that pretty much 
> works the same way that is modernized?
>  
> Thanks! 
> -Drew



Re: RTG

2019-10-30 Thread Nick Hilliard

Drew Weaver wrote on 30/10/2019 12:25:
We’ve been using this product for years and years 
http://rtg.sourceforge.net/ to collect and store SNMP statistics.


It has been working fine for us. I haven’t really been able to find much 
information about forks, new versions, and development happening on it.


A while back I heard that Yahoo created their own version of it but I 
could never find it.


that would have been yrtg:

http://mu.org/~billf/yrtg/

Does anyone know if there is a spiritual successor to RTG that pretty 
much works the same way that is modernized?


It was ok at the time, in its own way, but there are lots of other 
options these days, ranging from librenms to graphite, prometheus and 
that end of things, depending on what you're looking for in a graphing 
package.  Things moved on a bit in the area.


Nick



RTG

2019-10-30 Thread Drew Weaver
Hello,

We've been using this product for years and years http://rtg.sourceforge.net/ 
to collect and store SNMP statistics.

It has been working fine for us. I haven't really been able to find much 
information about forks, new versions, and development happening on it.

A while back I heard that Yahoo created their own version of it but I could 
never find it.

Does anyone know if there is a spiritual successor to RTG that pretty much 
works the same way that is modernized?

Thanks!
-Drew





Re: collectd as alternative to RTG for high-resolution polling and long term storage?

2016-03-19 Thread John Kinsella
Collectd is great, IMHO. I was using collectd+graphite to gather and display 
stats for a large collection of VMs, servers, routers, and switches. Collectd 
itself was pretty low overhead, easy to configure (I managed configs via 
puppet) and Just Worked.

Graphite and carbon cache were a little more tricky to set up - carbon by 
default aggregates/averages older data, so if not setup correctly, when you go 
back a few months and try to drill into a graph at a 5 minute interval, you get 
unexpected results.

I’d highly recommend looking at Graphite, as well. Once you get used to it, 
being able to apply functions[1] to aggregate, manipulate, and quickly find 
patterns in data is super useful (ex: look at all interfaces on this switch, 
only display graphs for the top 5 abnormal traffic). Jason Dixon has written 
some great blogs posts about it’s use on obfuscurity.com.

John
1: https://graphite.readthedocs.org/en/latest/functions.html

> On Mar 16, 2016, at 11:45 AM, Eric Kuhnke <eric.kuh...@gmail.com> wrote:
> 
> Would anyone care to share their experience using collectd as an
> alternative to rtg for high-resolution polling of interface traffic and
> long term storage?
> 
> I am investigating the various options for large data set size, lossless
> long term traffic charting (not RRAs which lose precision over time). One
> possible use is precision 95th billing.
> 
> https://collectd.org/



Re: collectd as alternative to RTG for high-resolution polling and long term storage?

2016-03-19 Thread Scott Larson
 Prometheus is also worth taking a look at.
 http://prometheus.io/docs/introduction/comparison/


*[image: userimage]Scott Larson[image: los angeles]
<https://www.google.com/maps/place/4216+Glencoe+Ave,+Marina+Del+Rey,+CA+90292/@33.9892151,-118.4421334,17z/data=!3m1!4b1!4m2!3m1!1s0x80c2ba88ffae914d:0x14e1d00084d4d09c>Lead
Systems Administrator[image: wdlogo] <https://www.wiredrive.com/> [image:
linkedin] <https://www.linkedin.com/company/wiredrive> [image: facebook]
<https://www.twitter.com/wiredrive> [image: twitter]
<https://www.facebook.com/wiredrive> [image: instagram]
<https://www.instagram.com/wiredrive>T 310 823 8238 x1106
<310%20823%208238%20x1106>  |  M 310 904 8818 <310%20904%208818>*

On Wed, Mar 16, 2016 at 5:52 PM, Peter Phaal <peter.ph...@gmail.com> wrote:

> On Wed, Mar 16, 2016 at 11:45 AM, Eric Kuhnke <eric.kuh...@gmail.com>
> wrote:
> > Would anyone care to share their experience using collectd as an
> > alternative to rtg for high-resolution polling of interface traffic and
> > long term storage?
> >
> > I am investigating the various options for large data set size, lossless
> > long term traffic charting (not RRAs which lose precision over time). One
> > possible use is precision 95th billing.
> >
> > https://collectd.org/
>
> Devices that support sFlow natively implement collectd type
> functionality for streaming interface counters to a time series
> database (InfluxDB, Graphite, OpenTSB, etc.) Tools like Grafana can be
> used to query the database and build dashboards.
>
> Host sFlow (http://sflow.net) is very similar to collectd in the
> metrics it exports, but with the added ability to export flow data
> from host adapters, bridges, vSwitches, firewalls, routing, VMs,
> containers etc.
>


Re: collectd as alternative to RTG for high-resolution polling and long term storage?

2016-03-19 Thread Louis Kowolowski
On Mar 16, 2016, at 11:45 AM, Eric Kuhnke <eric.kuh...@gmail.com> wrote:
> 
> Would anyone care to share their experience using collectd as an
> alternative to rtg for high-resolution polling of interface traffic and
> long term storage?
> 
> I am investigating the various options for large data set size, lossless
> long term traffic charting (not RRAs which lose precision over time). One
> possible use is precision 95th billing.
> 
> https://collectd.org/


Correct me if I’m wrong, but I believe that collectd uses RRD files for the 
backend, which you said you don’t want.

You might check out Grafana (http://grafana.org/ <http://grafana.org/>). Its 
based off graphite and uses something like opentsdb or influxdb for the 
backend. I think this is probably more what you’re looking for.

--
Louis Kowolowskilou...@cryptomonkeys.org 
<mailto:lou...@cryptomonkeys.org>
Cryptomonkeys:   http://www.cryptomonkeys.com/ 
<http://www.cryptomonkeys.com/>

Making life more interesting for people since 1977



signature.asc
Description: Message signed with OpenPGP using GPGMail


Re: collectd as alternative to RTG for high-resolution polling and long term storage?

2016-03-19 Thread Dale W. Carder
Thus spake Eric Kuhnke (eric.kuh...@gmail.com) on Wed, Mar 16, 2016 at 
11:45:26AM -0700:
> Would anyone care to share their experience using collectd as an
> alternative to rtg for high-resolution polling of interface traffic and
> long term storage?
> 
> I am investigating the various options for large data set size, lossless
> long term traffic charting (not RRAs which lose precision over time).

No, the storage interval is configurable and so are the (optional) 
consolidation functions.  You may want to look tuning at the defaults 
your application is choosing.

Dale


Re: collectd as alternative to RTG for high-resolution polling and long term storage?

2016-03-19 Thread John Kinsella
Collectd supports a large number “write” plugins[1] that can write out to 
various sources. I had been eyeing Grafana and OpenTSDB, they’re probably worth 
a look

John
1: https://collectd.org/wiki/index.php/Table_of_Plugins

> On Mar 16, 2016, at 12:35 PM, Louis Kowolowski <lou...@cryptomonkeys.org> 
> wrote:
> 
> On Mar 16, 2016, at 11:45 AM, Eric Kuhnke <eric.kuh...@gmail.com> wrote:
>> 
>> Would anyone care to share their experience using collectd as an
>> alternative to rtg for high-resolution polling of interface traffic and
>> long term storage?
>> 
>> I am investigating the various options for large data set size, lossless
>> long term traffic charting (not RRAs which lose precision over time). One
>> possible use is precision 95th billing.
>> 
>> https://collectd.org/
> 
> 
> Correct me if I’m wrong, but I believe that collectd uses RRD files for the 
> backend, which you said you don’t want.
> 
> You might check out Grafana (http://grafana.org/ <http://grafana.org/>). Its 
> based off graphite and uses something like opentsdb or influxdb for the 
> backend. I think this is probably more what you’re looking for.
> 
> --
> Louis Kowolowskilou...@cryptomonkeys.org 
> <mailto:lou...@cryptomonkeys.org>
> Cryptomonkeys:   
> http://www.cryptomonkeys.com/ <http://www.cryptomonkeys.com/>
> 
> Making life more interesting for people since 1977
> 



Re: collectd as alternative to RTG for high-resolution polling and long term storage?

2016-03-19 Thread Peter Phaal
On Wed, Mar 16, 2016 at 11:45 AM, Eric Kuhnke <eric.kuh...@gmail.com> wrote:
> Would anyone care to share their experience using collectd as an
> alternative to rtg for high-resolution polling of interface traffic and
> long term storage?
>
> I am investigating the various options for large data set size, lossless
> long term traffic charting (not RRAs which lose precision over time). One
> possible use is precision 95th billing.
>
> https://collectd.org/

Devices that support sFlow natively implement collectd type
functionality for streaming interface counters to a time series
database (InfluxDB, Graphite, OpenTSB, etc.) Tools like Grafana can be
used to query the database and build dashboards.

Host sFlow (http://sflow.net) is very similar to collectd in the
metrics it exports, but with the added ability to export flow data
from host adapters, bridges, vSwitches, firewalls, routing, VMs,
containers etc.


Re: collectd as alternative to RTG for high-resolution polling and long term storage?

2016-03-18 Thread Ulf Zimmermann
Be aware that collectd itself is a collection agent. It doesn't include
(last I checked) a grapher. There are however a number of graphers out
there to work with those RRD files, if you use that to store the data.

I personally have been using collectd across hundreds of Linux systems,
using rrdcached to a central collector and wrote my own grapher for that
stuff I am interested int.

Ulf.


On Wed, Mar 16, 2016 at 11:45 AM, Eric Kuhnke <eric.kuh...@gmail.com> wrote:

> Would anyone care to share their experience using collectd as an
> alternative to rtg for high-resolution polling of interface traffic and
> long term storage?
>
> I am investigating the various options for large data set size, lossless
> long term traffic charting (not RRAs which lose precision over time). One
> possible use is precision 95th billing.
>
> https://collectd.org/
>



-- 

Ulf Zimmermann, 1525 Pacific Ave., Alameda, CA-94501, #: 510-396-1764
You can find my resume at: http://www.Alameda.net/~ulf/resume.html


collectd as alternative to RTG for high-resolution polling and long term storage?

2016-03-18 Thread Eric Kuhnke
Would anyone care to share their experience using collectd as an
alternative to rtg for high-resolution polling of interface traffic and
long term storage?

I am investigating the various options for large data set size, lossless
long term traffic charting (not RRAs which lose precision over time). One
possible use is precision 95th billing.

https://collectd.org/