@hadoop.apache.orgmailto:user@hadoop.apache.org
Date: Friday, February 6, 2015 at 3:07 PM
To: user@hadoop.apache.orgmailto:user@hadoop.apache.org
user@hadoop.apache.orgmailto:user@hadoop.apache.org
Subject: Re: Adding datanodes to Hadoop cluster - Will data redistribute?
Hi Manoj,
Existing data is not automatically
Hi,
Have you tried;
$ hdfs balancer
On 02/06/2015 09:34 PM, Manoj Venkatesh wrote:
Dear Hadoop experts,
I have a Hadoop cluster of 8 nodes, 6 were added during cluster
creation and 2 additional nodes were added later to increase disk and
CPU capacity. What i see is that processing is
Look at the hadoop balancer - it will live data around and balance it across
the nodes.
Sent from the wilds on my BlackBerry smartphone.
From: Manoj Venkatesh
Sent: Friday, February 6, 2015 5:54 PM
To: user@hadoop.apache.org
Reply To: user@hadoop.apache.org
Subject: Adding datanodes to Hadoop
Hi Manoj,
You need to use balancer to re-balance data between nodes.
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HdfsUserGuide.html#Balancer
*dfs.datanode.fsdataset.volume.choosing.policy* have options 'Round
Robin' or 'Available Space', are there any other
Look at hdfs balancer
Artem Ervits
On Feb 6, 2015 5:54 PM, Manoj Venkatesh manove...@gmail.com wrote:
Dear Hadoop experts,
I have a Hadoop cluster of 8 nodes, 6 were added during cluster creation
and 2 additional nodes were added later to increase disk and CPU capacity.
What i see is that
Have you tried hdfs balancer?
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HDFSCommands.html#balancer
On Fri, Feb 6, 2015 at 11:34 AM, Manoj Venkatesh manove...@gmail.com
wrote:
Dear Hadoop experts,
I have a Hadoop cluster of 8 nodes, 6 were added during cluster
to Hadoop cluster - Will data redistribute?
Dear Hadoop experts,
I have a Hadoop cluster of 8 nodes, 6 were added during cluster creation and 2
additional nodes were added later to increase disk and CPU capacity. What i see
is that processing is shared amongst all the nodes whereas the storage
Hi Manoj,
Pls try
http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HdfsUserGuide.html#Balancer
Rg:
Vikas Parashar (Vicky)
On Sat, Feb 7, 2015 at 1:04 AM, Manoj Venkatesh manove...@gmail.com wrote:
Dear Hadoop experts,
I have a Hadoop cluster of 8 nodes, 6 were added
Dear Hadoop experts,
I have a Hadoop cluster of 8 nodes, 6 were added during cluster creation
and 2 additional nodes were added later to increase disk and CPU capacity.
What i see is that processing is shared amongst all the nodes whereas the
storage is reaching capacity on the original 6 nodes
