[ https://issues.apache.org/jira/browse/HDFS-13046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16337003#comment-16337003 ]
hu xiaodong edited comment on HDFS-13046 at 1/24/18 6:56 AM: ------------------------------------------------------------- Or we can consider the load after sorting by distance. After sorting by distance, if the datanode's load is greater than the average load * considerLoadFactor, then move the datanode to the end of the list. I submitted [^HDFS-13046-considerLoadAfterSortBydistance-001-sample.patch],welcome to discuss. was (Author: xiaodong.hu): Or we can consider the load after sorting by distance. After sorting by distance, if the datanode's load is greater than the average load * considerLoadFactor, then move the datanode to the end of the list. I submitted [^HDFS-13046-considerLoadAfterSortBydistance-001.patch],welcome to discuss. > consider load of datanodes when read blocks of file > --------------------------------------------------- > > Key: HDFS-13046 > URL: https://issues.apache.org/jira/browse/HDFS-13046 > Project: Hadoop HDFS > Issue Type: New Feature > Reporter: hu xiaodong > Assignee: hu xiaodong > Priority: Minor > Attachments: > HDFS-13046-considerLoadAfterSortBydistance-001-sample.patch, > HDFS-13046-sample.patch > > > When sorting block locations, we just consider the distance of datanodes. can > we consider the load of datanodes? We can add a configuration such as > 'dfs.namenode.reading.considerLoad', if set to true, then sort the > blocklocations by load of the datanodes, otherwise sort by distance. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org