M,
See http://wiki.apache.org/hadoop/FAQ - "3.6. I want to make a large
cluster smaller by taking out a bunch of nodes simultaneously. How can this
be done?"
This explains how to decomission nodes by moving the data off of the
existing node. It's fairly easy and painless (just add the nodename t
Our cluster has several nodes which have smaller disks than other nodes and
as a result fill up quicker.
I am looking to move data off these nodes and onto the others.
Here is what I am planning to do:
1) On the nodes with smaller disks, set dfs.datanode.du.reserved to a
larger value
2)
