about how the hdfs choose datanodes to store the files

Hi: all! we know that the hdfs divide a large file into several blocks(with each 64mb, 3 replications default). and once the metadata in the namenode are modified, there goes a thread dataStreamer to transport the blocks to the datanode. for each block, the client send the block to the 3 datanod

[jira] [Resolved] (HDFS-1894) Add constants for LAYOUT_VERSIONs in edits log branch

[ https://issues.apache.org/jira/browse/HDFS-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-1894. --- Resolution: Fixed Committed to branch under CTR policy. > Add constants for LAYOUT_VERSIONs in edits

[jira] [Created] (HDFS-1894) Add constants for LAYOUT_VERSIONs in edits log branch

Add constants for LAYOUT_VERSIONs in edits log branch - Key: HDFS-1894 URL: https://issues.apache.org/jira/browse/HDFS-1894 Project: Hadoop HDFS Issue Type: Sub-task Reporter: T

[jira] [Created] (HDFS-1893) Change edit logs and images to be named based on txid

Change edit logs and images to be named based on txid - Key: HDFS-1893 URL: https://issues.apache.org/jira/browse/HDFS-1893 Project: Hadoop HDFS Issue Type: Sub-task Reporter: T

[jira] [Created] (HDFS-1892) Update HDFS-1073 branch to deal with OP_INVALID-filled preallocation

Update HDFS-1073 branch to deal with OP_INVALID-filled preallocation Key: HDFS-1892 URL: https://issues.apache.org/jira/browse/HDFS-1892 Project: Hadoop HDFS Issue Type: Su

Hadoop-Hdfs-trunk-Commit - Build # 623 - Still Failing

See https://builds.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/623/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2830 lines...] [junit] Tests run: 3, Fai

Hadoop-Hdfs-trunk-Commit - Build # 622 - Still Failing

See https://builds.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/622/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2830 lines...] [junit] Tests run: 3, Fai

[jira] [Created] (HDFS-1891) TestBackupNode fails intermittently

TestBackupNode fails intermittently --- Key: HDFS-1891 URL: https://issues.apache.org/jira/browse/HDFS-1891 Project: Hadoop HDFS Issue Type: Bug Components: test Affects Versions: 0.23.0

[jira] [Created] (HDFS-1890) A few improvements on the LeaseRenewer.pendingCreates map

A few improvements on the LeaseRenewer.pendingCreates map - Key: HDFS-1890 URL: https://issues.apache.org/jira/browse/HDFS-1890 Project: Hadoop HDFS Issue Type: Improvement

Hadoop-Hdfs-trunk-Commit - Build # 621 - Still Failing

See https://builds.apache.org/hudson/job/Hadoop-Hdfs-trunk-Commit/621/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 2829 lines...] [junit] Tests run: 3, Fai

[jira] [Created] (HDFS-1889) incorrect path in start/stop dfs script

incorrect path in start/stop dfs script --- Key: HDFS-1889 URL: https://issues.apache.org/jira/browse/HDFS-1889 Project: Hadoop HDFS Issue Type: Bug Reporter: John George Assignee:

[jira] [Resolved] (HDFS-1888) MiniDFSCluster#corruptBlockOnDatanodes() access must be public for MapReduce contrib raid

[ https://issues.apache.org/jira/browse/HDFS-1888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-1888. --- Resolution: Fixed I committed the patch. > MiniDFSCluster#corruptBlockOnDatanodes() access m

[jira] [Created] (HDFS-1888) MiniDFSCluster#corruptBlockOnDatanodes() access must be public for MapReduce contrib raid

MiniDFSCluster#corruptBlockOnDatanodes() access must be public for MapReduce contrib raid - Key: HDFS-1888 URL: https://issues.apache.org/jira/browse/HDFS-1888 Pr

[jira] [Created] (HDFS-1887) If DataNode gets killed after 'data.dir' is created, but before LAYOUTVERSION is written to the storage file. The further restarts of the DataNode, an EOFException will be

If DataNode gets killed after 'data.dir' is created, but before LAYOUTVERSION is written to the storage file. The further restarts of the DataNode, an EOFException will be thrown while reading the storage file. -

Hadoop-Hdfs-trunk - Build # 656 - Still Failing

See https://builds.apache.org/hudson/job/Hadoop-Hdfs-trunk/656/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 795868 lines...] [junit] at java.lang.Threa