I changed our configs over to unicast, which as seemingly eliminated most of
our problems, except one egregious one, and the log files are still being
filled with

 illegal attempt to update using time 1210742641 when last update time is
1210742641 (minimum one second step)

The problem seems to be that the gmetad is not able to get new information
from headnodes.

In the case of 1210742641, the node had not reported to the headnode for 54
sec, and therefore rrdtool on the gmetad could not be expected to update a
file with the same information.

Output from headnodes for that node confirms.

<HOST NAME="HOSTNAME.twitter.com" IP="X.X.X.X" REPORTED="1210742641" TN="54"
TMAX="20" DMAX="86400" LOCATION="1" GMOND_STARTED="1210742641">

My question now is, why would gmond not be reporting for 54 sec?  The load
on the machines that are taking longer that 20 sec to report consistently is
lower than others in the cluster who report far more frequently.

Next, how can I change HOST TMAX if necessary? I've read the gmond.conf man
page, the wiki, etc... seems like only location is configurable for host in
the gmond.conf.

Again, system time is synchronized across all these machines to within .04
seconds.


Jeremy

On Tue, May 13, 2008 at 3:50 PM, Bernard Li <[EMAIL PROTECTED]> wrote:

> Hi Jeremy:
>
> On Tue, May 13, 2008 at 1:49 PM, Jeremy LaTrasse <[EMAIL PROTECTED]>
> wrote:
>
> > Where should I be going for comprehensive documentation that describes
> each
> > of the stanzas in both gmond and gmetad config files, is there one
> standard
> > document? I can't find one in the sourceforge wiki.
>
> For Ganglia 3.0.x, man gmond.conf is your best bet.  I checked and it
> talks about unicast.
>
> For gmetad -- the configuration options are pretty straightforward,
> and the comments in the standard gmetad.conf should be fairly
> self-explanatory.
>
> Cheers,
>
> Bernard
>
-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft 
Defy all challenges. Microsoft(R) Visual Studio 2008. 
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
Ganglia-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/ganglia-general

Reply via email to