In my experience you need to shut down the gmetad as well as the gmonds.
In addition, you may need to move the RRDs:
1.
Stop all gmonds
2.
Stop gmetad
3.
Move RRDs (for instance cd /var/lib/ganglia ; mv rrds rrds.6 ;
mkdir rrds )
4.
Start gmetad
5.
Start the gmonds
Martin Rushton
Weapons Technologies
Tel: 01959 514777, Mobile: 07939 219057
email: [email protected]
www.QinetiQ.com <http://www.qinetiq.com/>
QinetiQ - Delivering customer-focused solutions
Please consider the environment before printing this email.
________________________________
From: Cameron Spitzer [mailto:[email protected]]
Sent: 22 November 2010 22:23
To: Vladimir Vuksan; [email protected]
Cc: Louis Coilliot; Martin Knoblauch
Subject: Re: [Ganglia-general] restarting the gmond collector
node causes no data to be reported
Leaving the clarity and findability of the documented answer
aside,
does anyone know the actual answer to the original question?
We have a cluster with about twenty gmond nodes and one gmetad
host.
host_dmax is set to 3600.
Hosts that die never just disappear from the set of graphs.
We go through a nondeterministic procedure of restarting all of
the gmonds over and over again,
and eventually the dead graphs disappear and the gmonds begin
reporting again.
But I haven't been able to pin down exactly which restart
actually removes them, or why restarting a gmond usually makes
it stop reporting.
The readme says "ALL dead hosts will be flushed from the record
by restarting the processes"
but it seems there is more to it than that. It seems they have
to be restarted in a certain order,
but we haven't figured out what that order is.
Googling for this answer, I find a lot of folks asking it, and
some other folks telling
them to read the whole FAQ or the entire wiki, as if they hadn't
tried that already.
I also found some advice to shut the whole thing down, and then
bring it all back up again.
That's close, but we have to do it multiple times, and can't
figure out why.
Maybe someone who understands ganglia internals can explain it.
-Cameron
This email and any attachments to it may be confidential and are
intended solely for the use of the individual to whom it is
addressed. If you are not the intended recipient of this email,
you must neither take any action based upon its contents, nor
copy or show it to anyone. Please contact the sender if you
believe you have received this email in error. QinetiQ may
monitor email traffic data and also the content of email for
the purposes of security. QinetiQ Limited (Registered in England
& Wales: Company Number: 3796233) Registered office: 85
Buckingham Gate, London SW1E 6PD http://www.qinetiq.com.
------------------------------------------------------------------------------
Increase Visibility of Your 3D Game App & Earn a Chance To Win $500!
Tap into the largest installed PC base & get more eyes on your game by
optimizing for Intel(R) Graphics Technology. Get started today with the
Intel(R) Software Partner Program. Five $500 cash prizes are up for grabs.
http://p.sf.net/sfu/intelisp-dev2dev
_______________________________________________
Ganglia-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/ganglia-general
