Re: [Ganglia-general] Pointers on architecting a largescale ganglia setup??
--- Joel Krauska [EMAIL PROTECTED] wrote: Rick Mohr wrote: The unicast approach does save on gmond memory usage as you mentioned. It's up to each site to determine just how much memory the metrics will take up, and if it is considered a significant amount. (But it can get somewhat big on a large cluster like mine with a bunch of added metrics.) Can you share any code you've written for additional metrics? just in case you did not know: http://ganglia.sourceforge.net/gmetric/ Everyone is invited to contribute to the repository. Cheers Martin -- Martin Knoblauch email: k n o b i AT knobisoft DOT de www: http://www.knobisoft.de
Re: [Ganglia-general] Pointers on architecting a largescale ganglia setup??
Martin Knoblauch wrote: just in case you did not know: http://ganglia.sourceforge.net/gmetric/ Hadn't known about this -- thanks. Question: I just went an covnerted to using UDP unicasts. The gmetric man page seems to imply that it only supports the multicast comm method. Is there a way for gmetric just to report to the local gmond? DESCRIPTION The Ganglia Metric Client (gmetric) announces a metric value to all Ganglia Monitoring Daemons (gmonds) that are listening on the cluster multicast channel. I'll likely figure this out soon, but I thought I'd bring it up. --joel
Re: [Ganglia-general] Pointers on architecting a largescale ganglia setup??
The description may be a bit vague. The thing that gmetric does is insert the values into the running local gmond's xml. Then it's up to the gmond('s config) how it is sent, be it unicast or multicast. Joel Krauska wrote: Martin Knoblauch wrote: just in case you did not know: http://ganglia.sourceforge.net/gmetric/ Hadn't known about this -- thanks. Question: I just went an covnerted to using UDP unicasts. The gmetric man page seems to imply that it only supports the multicast comm method. Is there a way for gmetric just to report to the local gmond? DESCRIPTION The Ganglia Metric Client (gmetric) announces a metric value to all Ganglia Monitoring Daemons (gmonds) that are listening on the cluster multicast channel. I'll likely figure this out soon, but I thought I'd bring it up. --joel --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Ganglia-general mailing list Ganglia-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/ganglia-general -- ing. R. BastiaansHPC - Systems Programmer SARA - Computing and Networking Services Kruislaan 415PO Box 194613 1098 SJ Amsterdam1090 GP Amsterdam Tel. +31 (0) 20 592 3000 Fax. +31 (0) 20 668 3167 --- There are really only three types of people: Those who make things happen, those who watch things happen and those who say, What happened?
Re: [Ganglia-general] Pointers on architecting a largescale ganglia setup??
Joel, 2gmetric (at least in 3.0.x) takes a -c argument where you can specify the path to gmond.conf. gmetric will then use any transport defined for gmond. Simple, isn't it? Martin --- Joel Krauska [EMAIL PROTECTED] wrote: Martin Knoblauch wrote: just in case you did not know: http://ganglia.sourceforge.net/gmetric/ Hadn't known about this -- thanks. Question: I just went an covnerted to using UDP unicasts. The gmetric man page seems to imply that it only supports the multicast comm method. Is there a way for gmetric just to report to the local gmond? DESCRIPTION The Ganglia Metric Client (gmetric) announces a metric value to all Ganglia Monitoring Daemons (gmonds) that are listening on the cluster multicast channel. I'll likely figure this out soon, but I thought I'd bring it up. --joel -- Martin Knoblauch email: k n o b i AT knobisoft DOT de www: http://www.knobisoft.de
Re: [Ganglia-general] Pointers on architecting a largescale ganglia setup??
On Tue, Jan 31, 2006 at 12:15:19AM -0800, Martin Knoblauch wrote: just in case you did not know: http://ganglia.sourceforge.net/gmetric/ Everyone is invited to contribute to the repository. Martin, I believe someone else has pointed out that submissions have been closed (and apparently for a very long time...). I found most of the scripts there not quite right for what I wanted to do, so I wrote my own. I have put them up at http://cryptio.net/~ben/ganglia/ for your cunsumption. They include * disk - measures disk IO (per disk as well as cumulative) * network - reports per-interface stats (which I combined in a ganglia report to show all on one graph - fantastic for frontend/backend stuff) * mysql - reports queries per second as well as broken slow queries * sensors - CPU temp. et al for Tyan motherboards (may work for others) There is also a crontab file there for /etc/cron.d/ that calls them every two minutes and includes the (with this list's help) fixed num-users metric: */2 * * * * root /usr/bin/gmetric --name=users --value=`who | wc -l` --type=int16 One thing I like about these scripts is that they do a fair bit of error checking, so if something happens that might cause them to fail every two minutes, you don't get 100 messages in your inbox the next morning. For example, if mysqld dies on an unimportant box, you don't want to be inundated with messages. HTH, -ben p.s. these scripts have been written for a redhat-based linux installation (Fedora, CentOS, etc.). I don't know how portable they are. I expect not very much. :) -- Ben Hartshorne email: [EMAIL PROTECTED] http://ben.hartshorne.net signature.asc Description: Digital signature
Re: [Ganglia-general] Pointers on architecting a largescale ganglia setup??
Rick Mohr wrote: The unicast approach does save on gmond memory usage as you mentioned. It's up to each site to determine just how much memory the metrics will take up, and if it is considered a significant amount. (But it can get somewhat big on a large cluster like mine with a bunch of added metrics.) Can you share any code you've written for additional metrics? Thanks. BTW: Thanks eveyone for the pointers. --joel