[Ganglia-general] Monitoring Linux services

2016-12-16 Thread Peter Phaal
Hi All, For anyone interesting in monitoring Linux services, the latest Host sFlow release can automatically track and monitor services running under systemd: http://blog.sflow.com/2016/12/monitoring-linux-services.html Ganglia already includes support for the sFlow metrics:

Re: [Ganglia-general] ganglia web to monitor apache servers?

2015-12-31 Thread Peter Phaal
You could use a combination of Host sFlow and mod-sflow on your Apache web servers: http://www.sflow.net/ https://github.com/sflow/mod-sflow The following article describes how to configure the head-end gmond: http://blog.sflow.com/2011/12/using-ganglia-to-monitor-web-farms.html mod-sflow also

Re: [Ganglia-general] ganglia web to monitor apache servers?

2015-12-31 Thread Peter Phaal
Thu, Dec 31, 2015 at 12:05 PM, Peter Phaal <peter.ph...@gmail.com> wrote: >> >> You could use a combination of Host sFlow and mod-sflow on your Apache >> web servers: >> http://www.sflow.net/ >> https://github.com/sflow/mod-sflow >> >> The follow

Re: [Ganglia-general] Unable to collect Sflow data

2015-11-19 Thread Peter Phaal
sFlow reports on two types of data: 1. periodic export of counters 2. asynchronous export of randomly sampled packets and packet forwarding info Ganglia's data model is well suited to handling counters exported by the Host sFlow agent (http://sflow.net/), but does not provide support for

Re: [Ganglia-general] GMOND + SFLOWD functionality

2015-05-30 Thread Peter Phaal
Sergey, gmond does not retransmit the sFlow metrics it receives. A single gmond instance is used a central collector for a cluster of machines running Host sFlow agents. gmetad uses a TCP connection to retrieve the cluster stats from the single gmond instance and update the RRDs. Peter On Fri,

Re: [Ganglia-general] HTTPD metrics not sent

2015-05-28 Thread Peter Phaal
Have you enabled http in the sFlow section in the gmond config? http://blog.sflow.com/2011/12/using-ganglia-to-monitor-web-farms.html You should try running sflowtool on the head end gmond system to verify that the data is arriving: http://blog.sflow.com/2011/12/sflowtool.html On Thu, May 28,

Re: [Ganglia-general] Servers with multiple drives

2013-09-20 Thread Peter Phaal
the design and philosophy of ganglia and sflow. I will continue with nagios and NSClient++. ** ** Steve. ** ** *From:* Peter Phaal [mailto:peter.ph...@gmail.com] *Sent:* 04 September 2013 23:38 *To:* Burton, Steven *Cc:* ganglia-general@lists.sourceforge.net *Subject:* Re

Re: [Ganglia-general] Can't use sFlow and Ganglia

2013-03-12 Thread Peter Phaal
Does Virtualbox support libvirt? If so, you can compile the Host sFlow agent to link to the libvirt library to obtain VM statistics. Otherwise, if there is a Virtualbox specific performance library that can be used to retrieve metrics (Host sFlow uses libxenstat for Xen and WMI for Hyper-V) then

[Ganglia-general] InfiniBand monitoring

2013-02-27 Thread Peter Phaal
on the draft so we can move to finalize the specification. I would like to thank Peter Phaal for helping me with this contribution. Thanks, Ariel Almog Mellanox Technologies -- Everyone hates slow websites. So do we

Re: [Ganglia-general] Ganglia, mod_sflow and Apache response report

2013-02-05 Thread Peter Phaal
Michael, Ganglia doesn't understand the sampled HTTP transactions reported by mod_sflow and there is no response report built into Ganglia. To incorporate response time metrics based on the sFlow data, your would need to piece together a script using the elements described in the Ganglia book.

Re: [Ganglia-general] Sflow: custom metric are invisible

2012-12-19 Thread Peter Phaal
On the receiving end, have you configured gmond to listen for gmetric messages? udp_recv_channel { port = 8649 } On the sending end (host-sflow), your gmetric settings must be consistent with the hsflowd settings. The following message on the host-sflow mailing list describes how to read the

Re: [Ganglia-general] Question about scaling

2012-10-24 Thread Peter Phaal
Hi Mark, If you want to significantly reduce the amount of UDP traffic going to your head end gmond (cnode340), then you might want to consider using Host sFlow agents to monitor machines in the cluster - sFlow encodes all the core Ganglia metrics (along with additional disk IO, swap, interrupt

Re: [Ganglia-general] sflow metrics not visible

2012-10-20 Thread Peter Phaal
On Fri, Oct 19, 2012 at 1:59 PM, Иван Евдокимов palmal.moz...@gmail.com wrote: I'm trying to use sFlow(jmx-agent 0.6.1)-Ganglia(3.5.0, source build) pair for jvm monitoring. gmond.conf udp_recv_channel { port = 6343 } sflow { accept_vm_metrics = yes } When tcpdump port 6343 is fired, i

[Ganglia-general] GPU performance/health monitoring

2012-10-19 Thread Peter Phaal
Hi All, If you are running a GPU based compute cluster you might be interested in the recently added support for GPU performance/health metrics. http://blog.sflow.com/2012/10/using-ganglia-to-monitor-gpu-performance.html Please try out the new extensions at let us know if there are any issues

Re: [Ganglia-general] Impact of gmond polling on data collection

2012-09-19 Thread Peter Phaal
, Nicholas Satterly nfsatte...@gmail.com wrote: Hi Peter, Thanks for the feedback. I've added a thread mutex to the hosts hash table as you suggested and will send a pull request in the next day or so. Regards, Nick On Mon, Sep 17, 2012 at 8:25 PM, Peter Phaal peter.ph...@gmail.com wrote

Re: [Ganglia-general] Impact of gmond polling on data collection

2012-09-17 Thread Peter Phaal
Nicholas, It makes sense to multi-thread gmond, but looking at your patch, I don't see any locking associated with the hosts hashtable. Isn't there a possible race if new hosts/metrics are added to the hashtable by the UDP thread at the same time the hashtable is being walked by the TCP thread?

Re: [Ganglia-general] Java/JMX plugin for Ganglia 3.1.x

2012-09-14 Thread Peter Phaal
Martin, If you can upgrade to the latest Ganglia release you could use sFlow to monitor your Tomcat servers, the jxm-sflow-agent exports standard JVM metrics, or the tomcat-sflow-valve can export the JVM metrics as well as HTTP counters and transactions.

Re: [Ganglia-general] Easy Question: Ganglia + sFlow/NetFlow

2012-07-25 Thread Peter Phaal
Douglas, The sFlow standard includes a mechanism for periodically exporting counters. It is these periodic counter exports that Ganglia is processing - there is no equivalent mechanism in NetFlow. In addition, sFlow standardizes export of counters from servers and applications - it is these

Re: [Ganglia-general] gmond 3.4.0 and dell switches

2012-07-20 Thread Peter Phaal
The sFlow standard defines a wide range of metrics from switches, servers and applications. Each device only exports the metrics that are relevant to its normal operation, so switches will report network metrics, servers will report cpu, memory, disk statistics and applications will report

Re: [Ganglia-general] gmond 3.4.0 and dell switches

2012-07-20 Thread Peter Phaal
at 9:31 AM, Andreas Pflug pgad...@pse-consulting.de wrote: Well, for examining the overall health of a cluster the network fabric appears equally important to me... There seems no OS software for this combined? Regards Andreas Am 20.07.12 17:50, schrieb Peter Phaal: The sFlow standard

[Ganglia-general] Fwd: gmond 3.4.0 and dell switches

2012-07-20 Thread Peter Phaal
to get stuff like switch CPU utilization. Is this doable ? Vladimir On Fri, 20 Jul 2012, Peter Phaal wrote: I agree, the performance of the network fabric is a critical component of cluster performance and it would be great to figure out how to best include the data in Ganglia. A possible

Re: [Ganglia-general] Gmond Compilation on Cygwin

2012-07-12 Thread Peter Phaal
-Original Message- From: Bernard Li [mailto:bern...@vanhpc.org] Sent: Thursday, July 12, 2012 10:49 AM To: Nigel LEACH Cc: lozgachev.i...@gmail.com; ganglia-general@lists.sourceforge.net; Peter Phaal; Robert Alexander Subject: Re: [Ganglia-general] Gmond Compilation on Cygwin Hi Nigel

Re: [Ganglia-general] Gmond Compilation on Cygwin

2012-07-10 Thread Peter Phaal
Nigel, A simple option would be to use Host sFlow agents to export the core metrics from your Windows servers and use gmetric to send add the GPU metrics. You could combine code from the python GPU module and gmetric implementations to produce a self contained script for exporting GPU metrics:

[Ganglia-general] Using Ganglia/sFlow to monitor Hadoop

2012-04-20 Thread Peter Phaal
Hi All, I have been experimenting with setting up Ganglia with sFlow agents to monitor Hadoop. The configuration is described in the following article: http://blog.sflow.com/2012/04/hadoop.html The Ganglia 3.3 release is required to report on the sFlow java metrics. Peter

Re: [Ganglia-general] Ganglia for Windows

2012-04-11 Thread Peter Phaal
-construction.co.uk quoting the name of the sender. Whilst every care has been taken to check this outgoing e-mail for viruses it is seen as your responsibility to check and sweep it, and any attachments, for viruses on receipt. -Original Message- From: Peter Phaal [mailto:peter.ph

Re: [Ganglia-general] Ganglia for Windows

2012-04-05 Thread Peter Phaal
Can you verify that you are receiving performance metrics using the following command on your gmond server? tcpdump -p -s 0 -w - udp port 6343 | sflowtool The firewall on your windows server, every firewall in the path to the bsd collector, and the firewall on the bsd collector itself must be

Re: [Ganglia-general] Problem runnning gstat gmetric gmond

2012-02-26 Thread Peter Phaal
On Mon, Feb 20, 2012 at 9:06 AM, Mohit Dhingra mohitdhing...@gmail.com wrote: Hi Vladimir / All, Everything is working fine now (gmond and gmetad), I have installed ganglia on Dom0 OpenSUSE, with Xen as hypervisor. Now, I want to monitor VMs with the help of sflow, as you told earlier. I

Re: [Ganglia-general] Where does sFlow fit into the ganglia / java ecosystem?

2012-02-03 Thread Peter Phaal
Bryan, Since you want each of the nodes in the cluster to have access to the state its peers, implementing a full gmond equivalent peer sounds like the right call. However, I think that you might want to consider adding sFlow export functionality as well. It's helpful to have a clear

Re: [Ganglia-general] Ganglia 3.3.0 released

2012-02-02 Thread Peter Phaal
The following articles describe the sFlow metrics included in the Ganglia 3.3.0 and 3.2.0 releases: http://blog.sflow.com/2012/02/ganglia-33-released.html http://blog.sflow.com/2011/07/ganglia-32-released.html The Host sFlow agent efficiently exports standard Ganglia host metrics from Windows,

[Ganglia-general] Ganglia 3.2 and sFlow

2011-11-01 Thread Peter Phaal
Anyone curious about the sFlow functionality in Ganglia 3.2 should take a look at Dave Mangot's blog - he describes why Tagged.com is using Ganglia with sFlow. http://tech.mangot.com/roller/dave/entry/host_based_sflow_a_drop Peter

Re: [Ganglia-general] Ganglia 3.2.0 is out

2011-07-13 Thread Peter Phaal
On Wed, Jul 13, 2011 at 6:43 PM, Vladimir Vuksan vl...@vuksan.com wrote: Great. Would be possible to get a comprehensive guide on all the configuration options for sFlow stuff :-). There are very few configuration settings. Just the udp_port and the accept_vm_metrics settings, both are shown in

Re: [Ganglia-general] Ganglia 3.2.0 is out

2011-07-12 Thread Peter Phaal
On Tue, Jul 12, 2011 at 6:43 AM, Vladimir Vuksan vli...@veus.hr wrote: That's relatively easy to fix. In Gweb 2.1.0+ any metrics that don't exist show up as empty graphs with a legend that says No matching metrics found. We can certainly fix any other ones. We shouldn't let UI get in the way of

Re: [Ganglia-general] Ganglia 3.2.0 is out

2011-07-11 Thread Peter Phaal
rather than potentially needing to update many host-sflow agent machines. Thanks, Robert On Thu, Jul 7, 2011 at 11:26 PM, Peter Phaal peter.ph...@gmail.com wrote: Great news! For additional information on the sFlow feature and updated configuration instructions, see: http://blog.sflow.com

Re: [Ganglia-general] Ganglia 3.2.0 is out

2011-07-11 Thread Peter Phaal
On Mon, Jul 11, 2011 at 1:09 PM, Vladimir Vuksan vli...@veus.hr wrote: Peter, It is also my understanding that currently only metrics from physical hosts are supported. Is it possible to add network devices that support sFlow ? Thanks, Vladimir Currently the Ganglia UI is host oriented,

Re: [Ganglia-general] Ganglia 3.2.0 is out

2011-07-08 Thread Peter Phaal
Great news! For additional information on the sFlow feature and updated configuration instructions, see: http://blog.sflow.com/2011/07/ganglia-32-released.html On Thu, Jul 7, 2011 at 7:20 PM, Vladimir Vuksan vli...@veus.hr wrote: -- Forwarded message -- We are happy to announce

[Ganglia-general] Using Ganglia to monitor Rackspace cloudservers

2011-01-31 Thread Peter Phaal
Hi All, I have been experimenting with Ganglia for monitoring performance in the Rackspace cloud and it works very well: http://blog.sflow.com/2011/01/rackspace-cloudservers.html A big advantage of the gmond/sFlow data push model is that Ganglia automatically discovers cloud servers as they are

Re: [Ganglia-general] Ganglia and sFlow

2010-12-15 Thread Peter Phaal
of sFlow i used this http://bugzilla.ganglia.info/cgi-bin/bugzilla/show_bug.cgi?id=276 What can i do? thanks a lot Giovanni *From:* Peter Phaal peter.ph...@gmail.com *Sent:* Tuesday, December 07, 2010 6:34 PM *To:* Giovanni De Rosa giode...@hotmail.it *Cc:* ganglia-general

Re: [Ganglia-general] Ganglia and sFlow

2010-12-15 Thread peter . phaal
/show_bug.cgi?id=276 What can i do? thanks a lot Giovanni From: Peter Phaal Sent: Tuesday, December 07, 2010 6:34 PM To: Giovanni De Rosa Cc: ganglia-general@lists.sourceforge.net Subject: Re: [Ganglia-general] Ganglia and sFlow The following article

Re: [Ganglia-general] Ganglia and sFlow

2010-12-07 Thread Peter Phaal
The following article provides additional information on configuring the Ganglia development branch (trunk) to collect sFlow: http://blog.sflow.com/2010/10/ganglia.html Installing and configuring Host sFlow agents to send sFlow from Linux and Windows platforms is described in the articles:

[Ganglia-general] sFlow support in gmond

2010-10-25 Thread peter . phaal
Hello All, Here is some background on the sFlow support that has been added to gmond in the development branch: http://blog.sflow.com/2010/10/ganglia.html An sFlow agent is extremely lightweight, since sFlow monitoring is typically used in embedded environments where resources are