[ 
https://issues.apache.org/jira/browse/HDFS-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nathan Roberts updated HDFS-4946:
---------------------------------
    Attachment: HDFS-4946-2.patch

Uploaded a new version of this patch for trunk. We have found this config to be 
extremely useful across many large clusters. It avoids hot-spots for large 
files that can be quite problematic during localization and/or task scheduling.

Hopefully folks will be agreeable to this simple config option.

> Allow preferLocalNode in BlockPlacementPolicyDefault to be configurable
> -----------------------------------------------------------------------
>
>                 Key: HDFS-4946
>                 URL: https://issues.apache.org/jira/browse/HDFS-4946
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>          Components: namenode
>    Affects Versions: 2.0.0-alpha
>            Reporter: James Kinley
>            Assignee: James Kinley
>         Attachments: HDFS-4946-1.patch, HDFS-4946-2.patch
>
>
> Allow preferLocalNode in BlockPlacementPolicyDefault to be disabled in 
> configuration to prevent a client from writing the first replica of every 
> block (i.e. the entire file) to the local DataNode.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to