[
https://issues.apache.org/jira/browse/HDFS-17534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17853872#comment-17853872
]
ASF GitHub Bot commented on HDFS-17534:
---------------------------------------
yuanboliu commented on code in PR #6861:
URL: https://github.com/apache/hadoop/pull/6861#discussion_r1634096800
##########
hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/resolver/order/DestinationOrder.java:
##########
@@ -29,11 +29,14 @@ public enum DestinationOrder {
LOCAL, // Local first
RANDOM, // Random order
HASH_ALL, // Follow consistent hashing
- SPACE; // Available space based order
+ SPACE, // Available space based order
+ LEADER_FOLLOWER; // try leader sub-cluster first, if failed, try followers
/** Approaches that write folders in all subclusters. */
public static final EnumSet<DestinationOrder> FOLDER_ALL = EnumSet.of(
HASH_ALL,
RANDOM,
- SPACE);
+ SPACE,
+ // leader-follower mode should make sure all directory exists in case of
switching
Review Comment:
fixed it.
> RBF: Support leader follower mode for multiple subclusters
> ----------------------------------------------------------
>
> Key: HDFS-17534
> URL: https://issues.apache.org/jira/browse/HDFS-17534
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: rbf
> Reporter: Yuanbo Liu
> Assignee: Yuanbo Liu
> Priority: Major
> Labels: pull-request-available
>
> Currently there are five modes in multiple subclusters like
> HASH, LOCAL, RANDOM, HASH_ALL,SPACE;
> Proposal a new mode called leader/follower mode. routers try to write to
> leader subcluster as many as possible. When routers read data, put leader
> subcluster into first rank.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
