On Fri, Aug 12, 2011 at 11:58 AM, <[email protected]> wrote:
> Hi All, > > I'm trying to decommission data node from my cluster. I put the data node > in the /usr/lib/hadoop/conf/dfs.hosts.exclude list and restarted the name > nodes. The under-replicated blocks are starting to replicate, but it's > going down in a very slow pace. For 1 TB of data it takes over 1 day to > complete. We change the settings as below and try to increase the > replication rate. > > Added this to hdfs-site.xml on all the nodes on the cluster and restarted > the data nodes and name node processes. > <property> > <!-- 100Mbit/s --> > <name>dfs.balance.bandwidthPerSec</name> > <value>131072000</value> > </property> > > Speed didn't seem to pick up. Do you know what may be happening? > > Are you seeing any sort of resource starvation on your data nodes? I/O, network or CPU? Sridhar > Thanks! > Jonathan > > This message is for the designated recipient only and may contain > privileged, proprietary, or otherwise private information. If you have > received it in error, please notify the sender immediately and delete the > original. Any other use of the email by you is prohibited. >
