Hi all,
I'm running Hadoop 0.20.2. The balancer has suddenly stopped working. I'm
attempting to balance the cluster with a threshold of 1, using the following
command:
./hadoop balancer -threshold 1
This has been working fine, but suddenly it isn't. It skips though 5
iterations without actually doing any work:
Time Stamp Iteration# Bytes Already Moved Bytes Left To Move
Bytes Being Moved
Jan 4, 2012 11:47:56 AM 0 0 KB 1.87 GB
6.68 GB
Jan 4, 2012 11:47:56 AM 1 0 KB 1.87 GB
6.68 GB
Jan 4, 2012 11:47:56 AM 2 0 KB 1.87 GB
6.68 GB
Jan 4, 2012 11:47:57 AM 3 0 KB 1.87 GB
6.68 GB
Jan 4, 2012 11:47:57 AM 4 0 KB 1.87 GB
6.68 GB
No block has been moved for 5 iterations. Exiting...
Balancing took 524.0 milliseconds
I've attached the full log, but I can't see any errors indicating why it is
failing. Any ideas? I'd really like to get balancing working again. My use
case isn't the norm, and it is important that the cluster stay as close to
completely balanced as possible.
--
Landy Bible
Simulation and Computer Specialist
School of Nursing - Collins College of Business
The University of Tulsa