Re: [Ganglia-general] Pointers on architecting a largescale ganglia setup??

2006-01-31 Thread Martin Knoblauch

--- Joel Krauska [EMAIL PROTECTED] wrote:

 Rick Mohr wrote:
  The unicast approach does save on gmond memory usage as you
 mentioned.  
  It's up to each site to determine just how much memory the metrics
 will 
  take up, and if it is considered a significant amount.  (But it can
 get 
  somewhat big on a large cluster like mine with a bunch of added
 metrics.)
 
 Can you share any code you've written for additional metrics?


 just in case you did not know:

 http://ganglia.sourceforge.net/gmetric/

 Everyone is invited to contribute to the repository.

Cheers
Martin


--
Martin Knoblauch
email: k n o b i AT knobisoft DOT de
www:   http://www.knobisoft.de



Re: [Ganglia-general] Pointers on architecting a largescale ganglia setup??

2006-01-31 Thread Joel Krauska

Martin Knoblauch wrote:

 just in case you did not know:

 http://ganglia.sourceforge.net/gmetric/


Hadn't known about this -- thanks.

Question:
I just went an covnerted to using UDP unicasts.

The gmetric man page seems to imply that it only supports the multicast 
comm method.  Is there a way for gmetric just to report to the local gmond?


DESCRIPTION
   The Ganglia Metric Client (gmetric) announces a metric value to 
all Ganglia Monitoring Daemons (gmonds) that are listening on the 
cluster multicast channel.


I'll likely figure this out soon, but I thought I'd bring it up.

--joel



Re: [Ganglia-general] Pointers on architecting a largescale ganglia setup??

2006-01-31 Thread Ramon Bastiaans

The description may be a bit vague.

The thing that gmetric does is insert the values into the running local 
gmond's xml.
Then it's up to the gmond('s config) how it is sent, be it unicast or 
multicast.


Joel Krauska wrote:


Martin Knoblauch wrote:


 just in case you did not know:

 http://ganglia.sourceforge.net/gmetric/



Hadn't known about this -- thanks.

Question:
I just went an covnerted to using UDP unicasts.

The gmetric man page seems to imply that it only supports the 
multicast comm method.  Is there a way for gmetric just to report to 
the local gmond?


DESCRIPTION
   The Ganglia Metric Client (gmetric) announces a metric value to 
all Ganglia Monitoring Daemons (gmonds) that are listening on the 
cluster multicast channel.


I'll likely figure this out soon, but I thought I'd bring it up.

--joel


---
This SF.net email is sponsored by: Splunk Inc. Do you grep through log 
files

for problems?  Stop!  Download the new AJAX search engine that makes
searching your log files as easy as surfing the  web.  DOWNLOAD SPLUNK!
http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642
___
Ganglia-general mailing list
Ganglia-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/ganglia-general



--
ing. R. BastiaansHPC - Systems Programmer

SARA - Computing and Networking Services
Kruislaan 415PO Box 194613
1098 SJ Amsterdam1090 GP Amsterdam
Tel. +31 (0) 20 592 3000 Fax. +31 (0) 20 668 3167
---
There are really only three types of people:

 Those who make things happen, those who watch things happen
 and those who say, What happened?




Re: [Ganglia-general] Pointers on architecting a largescale ganglia setup??

2006-01-31 Thread Martin Knoblauch
Joel,

 2gmetric (at least in 3.0.x) takes a -c argument where you can
specify the path to gmond.conf. gmetric will then use any transport
defined for gmond. Simple, isn't it?

Martin

--- Joel Krauska [EMAIL PROTECTED] wrote:

 Martin Knoblauch wrote:
   just in case you did not know:
  
   http://ganglia.sourceforge.net/gmetric/
 
 Hadn't known about this -- thanks.
 
 Question:
 I just went an covnerted to using UDP unicasts.
 
 The gmetric man page seems to imply that it only supports the
 multicast 
 comm method.  Is there a way for gmetric just to report to the local
 gmond?
 
 DESCRIPTION
 The Ganglia Metric Client (gmetric) announces a metric value
 to 
 all Ganglia Monitoring Daemons (gmonds) that are listening on the 
 cluster multicast channel.
 
 I'll likely figure this out soon, but I thought I'd bring it up.
 
 --joel
 
 


--
Martin Knoblauch
email: k n o b i AT knobisoft DOT de
www:   http://www.knobisoft.de



Re: [Ganglia-general] Pointers on architecting a largescale ganglia setup??

2006-01-31 Thread Ben Hartshorne
On Tue, Jan 31, 2006 at 12:15:19AM -0800, Martin Knoblauch wrote:
 
  just in case you did not know:
 
  http://ganglia.sourceforge.net/gmetric/
 
  Everyone is invited to contribute to the repository.

Martin,

I believe someone else has pointed out that submissions have been closed
(and apparently for a very long time...).

I found most of the scripts there not quite right for what I wanted to
do, so I wrote my own.  

I have put them up at http://cryptio.net/~ben/ganglia/ for your
cunsumption.  They include
* disk - measures disk IO (per disk as well as cumulative)
* network - reports per-interface stats (which I combined in a ganglia
  report to show all on one graph - fantastic for frontend/backend stuff)
* mysql - reports queries per second as well as broken slow queries
* sensors - CPU temp. et al for Tyan motherboards (may work for others)

There is also a crontab file there for /etc/cron.d/ that calls them
every two minutes and includes the (with this list's help) fixed
num-users metric:
*/2 * * * * root /usr/bin/gmetric --name=users --value=`who | wc -l` 
--type=int16

One thing I like about these scripts is that they do a fair bit of error
checking, so if something happens that might cause them to fail every
two minutes, you don't get 100 messages in your inbox the next morning.
For example, if mysqld dies on an unimportant box, you don't want to be
inundated with messages.  

HTH,

-ben

p.s.  these scripts have been written for a redhat-based linux
installation (Fedora, CentOS, etc.).  I don't know how portable they
are.  I expect not very much.  :)


-- 
Ben Hartshorne
email: [EMAIL PROTECTED]
http://ben.hartshorne.net


signature.asc
Description: Digital signature


Re: [Ganglia-general] Pointers on architecting a largescale ganglia setup??

2006-01-30 Thread Joel Krauska

Rick Mohr wrote:
The unicast approach does save on gmond memory usage as you mentioned.  
It's up to each site to determine just how much memory the metrics will 
take up, and if it is considered a significant amount.  (But it can get 
somewhat big on a large cluster like mine with a bunch of added metrics.)


Can you share any code you've written for additional metrics?

Thanks.

BTW: Thanks eveyone for the pointers.

--joel