We're about in the same boat as you. We use Nagios and have Cacti for other things so I'll probably use it for hadoop as well. Ganglia seems interesting but not too simple to setup. We also tried Cloudera Desktop which gives you a nice interface to see what's happening but it requires using Cloudera's hadoop and seems more focused on real-time status as opposed to background monitoring.
I'd be interested to hear more of what other people have been successful with. Anyone? -Kevin On Thu, Nov 12, 2009 at 6:22 AM, John Martyniak < j...@beforedawnsolutions.com> wrote: > I do already use Nagios, and have been monitoring the availability etc, of > the network. > > But I was hoping to get more insight into the load/workings of the hadoop > network and Ganglia seemed like a good start. > > Do you use either Ganglia or Cacti, or something else? > > -John > > > On Nov 12, 2009, at 12:51 AM, Kevin Sweeney wrote: > > Nagios is always a good start. This webcast has some good information on >> this subject: >> >> http://www.cloudera >> >> .com/blog/2009/11/09/hadoop-world-monitoring-best-practices-from-ed-capriolo/ >> >> < >> http://www.cloudera.com/blog/2009/11/09/hadoop-world-monitoring-best-practices-from-ed-capriolo/ >> > >> >> On Wed, Nov 11, 2009 at 10:46 PM, John Martyniak < >> j...@beforedawnsolutions.com> wrote: >> >> Is there a good solution for Hadoop node monitoring? I know that Cacti >>> and >>> Ganglia are probably the two big ones, but are they the best ones to use? >>> Easiest to setup? Most thorough reporting, etc. >>> >>> I started to play with Ganglia, and the install is crazy, I am installing >>> it on CentOS and having all sorts of troubles. So any idea there would >>> be >>> very helpful. >>> >>> Thank you, >>> >>> -John >>> >>> >>> >
