Hey ganglia gurus -

SHORT VERSION:
Some gmetric-published stats available at a local gmond are not being
published to other gmond instances. However, some stats are shared
between gmond instances. Any ideas why some stats would not be shared
while others are?


DETAILS:
I'm in the process of using Ganglia to monitor a Hadoop cluster and
have encountered a strange issue. All cluster nodes have basic stats
being collected and shared as expected (such as mem_buffers). Hadoop
stats are being published to the local gmond as expected (such as
dfs.datanode.blocks_verified). However, the hadoop stats are not being
shared amongst gmond instances and thus are not collected by gmetad. I
don't think the issue is Hadoop-specific.


Telnetting to the local gmond and looking at its XML output I see the
Hadoop stats as expected; for example:

<METRIC NAME="dfs.datanode.blocks_verified" VAL="18364" TYPE="int32"
UNITS="" TN="3" TMAX="60" DMAX="0" SLOPE="both" SOURCE="gmetric"/>


Looking at another gmond (listed in udp_send_channel) we see the host
is present an up-to-date. For example:

<HOST NAME="foo.bar.com" IP="1.2.3.4" REPORTED="1261436155" TN="2"
TMAX="20" DMAX="86400" LOCATION="1" GMOND_STARTED="1261434025">
<METRIC NAME="mem_buffers" VAL="336572" TYPE="uint32" UNITS="KB"
TN="2" TMAX="180" DMAX="0" SLOPE="both" SOURCE="gmond"/>

However, the dfs.datanode.blocks_verified statistic is not present.
Any tips on how to troubleshoot this would be extremely helpful as I'm
not sure why a subset of metrics would be shared.

Thanks!
Travis

------------------------------------------------------------------------------
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev 
_______________________________________________
Ganglia-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/ganglia-general

Reply via email to