Hi, I have a small cluster (15 nodes x86_64 RHE4/FC4 mixed about 50/50). I recently built and installed v3.0.3 making only minor changes to the gmond.conf file: <CLUSTER> name, owner, latlong, url and location. The gmond.conf file is identical across the nodes and they are running the same NFS shared binary. The only change I made to gmetad.conf is the data_source line.
If I am only running gmond on the head node (where gmetad is running) ganglia reports correct and accurate info in the Physical View for the head node, however the images are empty where graphs are supposed to be. All I see is the std. red "x" and image name with a border. If I start gmond on any other node, the node will infrequently report a value for load and will appear up for about 1-3 mins, but CPU/Hardware/Software are not reported - same problem with the images of the graphs. If I start gmond on all the nodes and the stop it on the head node, node01 will begin reporting accurately in the Physical View, all others reported as down, no images. If I stop node01, node02 reports correctly (still no images), etc. I have done this up through node05 with same results. Nothing weird in dmesg or messages and everything looks OK when I run gmond in debug. When I look at the debug of gmetad, the updates of all nodes except the one reporting correctly are very infrequent. All these nodes are single 1Gb nic attached to the same blade on a cisco 6500. Windows DHCP and DNS ;-0. I have also tried installing/running the rpm on some of the nodes with the same outcome. This is the first time I have used Ganglia, so I am not certain if I am making an obvious newbie mistake. Any & all suggestions are welcom, the amount of time I have already spent without a breakthrough is embarrassingly large. Thx, Chris
