Re: HDFS Block placement policy

2016-05-22 Thread Gurmukh Singh
wrote: Hi all, I have a question related to HDFS Block placement policy. The default, "The default block placement policy is as follows: Place the first replica somewhere – either a random node (if the HDFS client is outside the Hadoop/DataNode cluster) or on the local node (if the HDFS clie

HDFS Block placement policy

2016-05-19 Thread Ruhua Jiang
Hi all, I have a question related to HDFS Block placement policy. The default, "The default block placement policy is as follows: Place the first replica somewhere – either a random node (if the HDFS client is outside the Hadoop/DataNode cluster) or on the local node (if the HDFS clie

RE: HDFS block placement

2013-07-26 Thread German Florez-Larrahondo
] Sent: Friday, July 26, 2013 6:45 AM To: user@hadoop.apache.org Subject: HDFS block placement Hey, I am a bit confused about the block placement in Hadoop. Assume that there is no replication and a task (map or reduce) writes a file to HDFS, will be all blocks stored on the same local node (the no

Re: HDFS block placement

2013-07-26 Thread Harsh J
Your thought is correct. If space is available locally, then it is automatically stored locally. On Fri, Jul 26, 2013 at 5:14 PM, Lukas Kairies wrote: > Hey, > > I am a bit confused about the block placement in Hadoop. Assume that there > is no replication and a task (map or reduce) writes a file

HDFS block placement

2013-07-26 Thread Lukas Kairies
Hey, I am a bit confused about the block placement in Hadoop. Assume that there is no replication and a task (map or reduce) writes a file to HDFS, will be all blocks stored on the same local node (the node on which the task runs)? I think yes but I am node sure. Kind Regards, Lukas Kairies