[21/50] hadoop git commit: HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin.
HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/4743d4a2 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/4743d4a2 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/4743d4a2 Branch: refs/heads/HDFS-7240 Commit: 4743d4a2c70a213a41804a24c776e6db00e1b90d Parents: 8133cd5 Author: Yiqun LinAuthored: Sat Mar 10 11:28:55 2018 +0800 Committer: Yiqun Lin Committed: Sat Mar 10 11:28:55 2018 +0800 -- .../src/site/markdown/HDFSRouterFederation.md | 12 +++- 1 file changed, 7 insertions(+), 5 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/4743d4a2/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md -- diff --git a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md index 5412aae..fdaaa11 100644 --- a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md +++ b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md @@ -29,7 +29,9 @@ Architecture A natural extension to this partitioned federation is to add a layer of software responsible for federating the namespaces. -This extra layer allows users to access any subcluster transparently, lets subclusters manage their own block pools independently, and supports rebalancing of data across subclusters. +This extra layer allows users to access any subcluster transparently, lets subclusters manage their own block pools independently, and will support rebalancing of data across subclusters later +(see more info in [HDFS-13123](https://issues.apache.org/jira/browse/HDFS-13123)). The subclusters in RBF are not required to be the independent HDFS clusters, a normal federation cluster +(with multiple block pools) or a mixed cluster with federation and independent cluster is also allowed. To accomplish these goals, the federation layer directs block accesses to the proper subcluster, maintains the state of the namespaces, and provides mechanisms for data rebalancing. This layer must be scalable, highly available, and fault tolerant. @@ -324,8 +326,8 @@ The connection to the State Store and the internal caching at the Router. | Property | Default | Description| |: |: |: | | dfs.federation.router.store.enable | `true` | If `true`, the Router connects to the State Store. | -| dfs.federation.router.store.serializer | `StateStoreSerializerPBImpl` | Class to serialize State Store records. | -| dfs.federation.router.store.driver.class | `StateStoreZooKeeperImpl` | Class to implement the State Store. | +| dfs.federation.router.store.serializer | `org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreSerializerPBImpl` | Class to serialize State Store records. | +| dfs.federation.router.store.driver.class | `org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreZooKeeperImpl` | Class to implement the State Store. | | dfs.federation.router.store.connection.test | 6 | How often to check for the connection to the State Store in milliseconds. | | dfs.federation.router.cache.ttl | 6 | How often to refresh the State Store caches in milliseconds. | | dfs.federation.router.store.membership.expiration | 30 | Expiration time in milliseconds for a membership record. | @@ -336,8 +338,8 @@ Forwarding client requests to the right subcluster. | Property | Default | Description| |: |: |: | -| dfs.federation.router.file.resolver.client.class | MountTableResolver | Class to resolve files to subclusters. | -| dfs.federation.router.namenode.resolver.client.class | MembershipNamenodeResolver | Class to resolve the namenode for a subcluster. | +| dfs.federation.router.file.resolver.client.class | `org.apache.hadoop.hdfs.server.federation.resolver.MountTableResolver` | Class to resolve files to subclusters. | +| dfs.federation.router.namenode.resolver.client.class | `org.apache.hadoop.hdfs.server.federation.resolver.MembershipNamenodeResolver` | Class to resolve the namenode for a subcluster. | ### Namenode monitoring - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
[23/50] hadoop git commit: HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin.
HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/4743d4a2 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/4743d4a2 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/4743d4a2 Branch: refs/heads/HDFS-12996 Commit: 4743d4a2c70a213a41804a24c776e6db00e1b90d Parents: 8133cd5 Author: Yiqun LinAuthored: Sat Mar 10 11:28:55 2018 +0800 Committer: Yiqun Lin Committed: Sat Mar 10 11:28:55 2018 +0800 -- .../src/site/markdown/HDFSRouterFederation.md | 12 +++- 1 file changed, 7 insertions(+), 5 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/4743d4a2/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md -- diff --git a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md index 5412aae..fdaaa11 100644 --- a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md +++ b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md @@ -29,7 +29,9 @@ Architecture A natural extension to this partitioned federation is to add a layer of software responsible for federating the namespaces. -This extra layer allows users to access any subcluster transparently, lets subclusters manage their own block pools independently, and supports rebalancing of data across subclusters. +This extra layer allows users to access any subcluster transparently, lets subclusters manage their own block pools independently, and will support rebalancing of data across subclusters later +(see more info in [HDFS-13123](https://issues.apache.org/jira/browse/HDFS-13123)). The subclusters in RBF are not required to be the independent HDFS clusters, a normal federation cluster +(with multiple block pools) or a mixed cluster with federation and independent cluster is also allowed. To accomplish these goals, the federation layer directs block accesses to the proper subcluster, maintains the state of the namespaces, and provides mechanisms for data rebalancing. This layer must be scalable, highly available, and fault tolerant. @@ -324,8 +326,8 @@ The connection to the State Store and the internal caching at the Router. | Property | Default | Description| |: |: |: | | dfs.federation.router.store.enable | `true` | If `true`, the Router connects to the State Store. | -| dfs.federation.router.store.serializer | `StateStoreSerializerPBImpl` | Class to serialize State Store records. | -| dfs.federation.router.store.driver.class | `StateStoreZooKeeperImpl` | Class to implement the State Store. | +| dfs.federation.router.store.serializer | `org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreSerializerPBImpl` | Class to serialize State Store records. | +| dfs.federation.router.store.driver.class | `org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreZooKeeperImpl` | Class to implement the State Store. | | dfs.federation.router.store.connection.test | 6 | How often to check for the connection to the State Store in milliseconds. | | dfs.federation.router.cache.ttl | 6 | How often to refresh the State Store caches in milliseconds. | | dfs.federation.router.store.membership.expiration | 30 | Expiration time in milliseconds for a membership record. | @@ -336,8 +338,8 @@ Forwarding client requests to the right subcluster. | Property | Default | Description| |: |: |: | -| dfs.federation.router.file.resolver.client.class | MountTableResolver | Class to resolve files to subclusters. | -| dfs.federation.router.namenode.resolver.client.class | MembershipNamenodeResolver | Class to resolve the namenode for a subcluster. | +| dfs.federation.router.file.resolver.client.class | `org.apache.hadoop.hdfs.server.federation.resolver.MountTableResolver` | Class to resolve files to subclusters. | +| dfs.federation.router.namenode.resolver.client.class | `org.apache.hadoop.hdfs.server.federation.resolver.MembershipNamenodeResolver` | Class to resolve the namenode for a subcluster. | ### Namenode monitoring - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin.
Repository: hadoop Updated Branches: refs/heads/branch-2.9 a3c47eba7 -> 56ac7db7e HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin. (cherry picked from commit 4743d4a2c70a213a41804a24c776e6db00e1b90d) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/56ac7db7 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/56ac7db7 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/56ac7db7 Branch: refs/heads/branch-2.9 Commit: 56ac7db7ec61f9cd492ea9e72bf3a42241e4d724 Parents: a3c47eb Author: Yiqun LinAuthored: Sat Mar 10 11:28:55 2018 +0800 Committer: Yiqun Lin Committed: Sat Mar 10 11:34:42 2018 +0800 -- .../src/site/markdown/HDFSRouterFederation.md | 12 +++- 1 file changed, 7 insertions(+), 5 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/56ac7db7/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md -- diff --git a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md index 600c38e..14fa179 100644 --- a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md +++ b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md @@ -29,7 +29,9 @@ Architecture A natural extension to this partitioned federation is to add a layer of software responsible for federating the namespaces. -This extra layer allows users to access any subcluster transparently, lets subclusters manage their own block pools independently, and supports rebalancing of data across subclusters. +This extra layer allows users to access any subcluster transparently, lets subclusters manage their own block pools independently, and will support rebalancing of data across subclusters later +(see more info in [HDFS-13123](https://issues.apache.org/jira/browse/HDFS-13123)). The subclusters in RBF are not required to be the independent HDFS clusters, a normal federation cluster +(with multiple block pools) or a mixed cluster with federation and independent cluster is also allowed. To accomplish these goals, the federation layer directs block accesses to the proper subcluster, maintains the state of the namespaces, and provides mechanisms for data rebalancing. This layer must be scalable, highly available, and fault tolerant. @@ -304,8 +306,8 @@ The connection to the State Store and the internal caching at the Router. | Property | Default | Description| |: |: |: | | dfs.federation.router.store.enable | `true` | If `true`, the Router connects to the State Store. | -| dfs.federation.router.store.serializer | `StateStoreSerializerPBImpl` | Class to serialize State Store records. | -| dfs.federation.router.store.driver.class | `StateStoreZooKeeperImpl` | Class to implement the State Store. | +| dfs.federation.router.store.serializer | `org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreSerializerPBImpl` | Class to serialize State Store records. | +| dfs.federation.router.store.driver.class | `org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreZooKeeperImpl` | Class to implement the State Store. | | dfs.federation.router.store.connection.test | 6 | How often to check for the connection to the State Store in milliseconds. | | dfs.federation.router.cache.ttl | 6 | How often to refresh the State Store caches in milliseconds. | | dfs.federation.router.store.membership.expiration | 30 | Expiration time in milliseconds for a membership record. | @@ -316,8 +318,8 @@ Forwarding client requests to the right subcluster. | Property | Default | Description| |: |: |: | -| dfs.federation.router.file.resolver.client.class | MountTableResolver | Class to resolve files to subclusters. | -| dfs.federation.router.namenode.resolver.client.class | MembershipNamenodeResolver | Class to resolve the namenode for a subcluster. | +| dfs.federation.router.file.resolver.client.class | `org.apache.hadoop.hdfs.server.federation.resolver.MountTableResolver` | Class to resolve files to subclusters. | +| dfs.federation.router.namenode.resolver.client.class | `org.apache.hadoop.hdfs.server.federation.resolver.MembershipNamenodeResolver` | Class to resolve the namenode for a subcluster. | ### Namenode monitoring - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin.
Repository: hadoop Updated Branches: refs/heads/branch-2 0dadcf9ea -> 3a3492489 HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin. (cherry picked from commit 4743d4a2c70a213a41804a24c776e6db00e1b90d) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/3a349248 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/3a349248 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/3a349248 Branch: refs/heads/branch-2 Commit: 3a349248960bc560b8ac63fea05e458775a42387 Parents: 0dadcf9 Author: Yiqun LinAuthored: Sat Mar 10 11:28:55 2018 +0800 Committer: Yiqun Lin Committed: Sat Mar 10 11:33:44 2018 +0800 -- .../src/site/markdown/HDFSRouterFederation.md | 12 +++- 1 file changed, 7 insertions(+), 5 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/3a349248/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md -- diff --git a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md index 5412aae..fdaaa11 100644 --- a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md +++ b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md @@ -29,7 +29,9 @@ Architecture A natural extension to this partitioned federation is to add a layer of software responsible for federating the namespaces. -This extra layer allows users to access any subcluster transparently, lets subclusters manage their own block pools independently, and supports rebalancing of data across subclusters. +This extra layer allows users to access any subcluster transparently, lets subclusters manage their own block pools independently, and will support rebalancing of data across subclusters later +(see more info in [HDFS-13123](https://issues.apache.org/jira/browse/HDFS-13123)). The subclusters in RBF are not required to be the independent HDFS clusters, a normal federation cluster +(with multiple block pools) or a mixed cluster with federation and independent cluster is also allowed. To accomplish these goals, the federation layer directs block accesses to the proper subcluster, maintains the state of the namespaces, and provides mechanisms for data rebalancing. This layer must be scalable, highly available, and fault tolerant. @@ -324,8 +326,8 @@ The connection to the State Store and the internal caching at the Router. | Property | Default | Description| |: |: |: | | dfs.federation.router.store.enable | `true` | If `true`, the Router connects to the State Store. | -| dfs.federation.router.store.serializer | `StateStoreSerializerPBImpl` | Class to serialize State Store records. | -| dfs.federation.router.store.driver.class | `StateStoreZooKeeperImpl` | Class to implement the State Store. | +| dfs.federation.router.store.serializer | `org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreSerializerPBImpl` | Class to serialize State Store records. | +| dfs.federation.router.store.driver.class | `org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreZooKeeperImpl` | Class to implement the State Store. | | dfs.federation.router.store.connection.test | 6 | How often to check for the connection to the State Store in milliseconds. | | dfs.federation.router.cache.ttl | 6 | How often to refresh the State Store caches in milliseconds. | | dfs.federation.router.store.membership.expiration | 30 | Expiration time in milliseconds for a membership record. | @@ -336,8 +338,8 @@ Forwarding client requests to the right subcluster. | Property | Default | Description| |: |: |: | -| dfs.federation.router.file.resolver.client.class | MountTableResolver | Class to resolve files to subclusters. | -| dfs.federation.router.namenode.resolver.client.class | MembershipNamenodeResolver | Class to resolve the namenode for a subcluster. | +| dfs.federation.router.file.resolver.client.class | `org.apache.hadoop.hdfs.server.federation.resolver.MountTableResolver` | Class to resolve files to subclusters. | +| dfs.federation.router.namenode.resolver.client.class | `org.apache.hadoop.hdfs.server.federation.resolver.MembershipNamenodeResolver` | Class to resolve the namenode for a subcluster. | ### Namenode monitoring - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin.
Repository: hadoop Updated Branches: refs/heads/branch-3.0 465c3f0e2 -> 2e607f210 HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin. (cherry picked from commit 4743d4a2c70a213a41804a24c776e6db00e1b90d) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/2e607f21 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/2e607f21 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/2e607f21 Branch: refs/heads/branch-3.0 Commit: 2e607f2103bf0a50e838431a2f356366c71a0d80 Parents: 465c3f0 Author: Yiqun LinAuthored: Sat Mar 10 11:28:55 2018 +0800 Committer: Yiqun Lin Committed: Sat Mar 10 11:32:12 2018 +0800 -- .../src/site/markdown/HDFSRouterFederation.md | 12 +++- 1 file changed, 7 insertions(+), 5 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/2e607f21/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md -- diff --git a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md index 600c38e..14fa179 100644 --- a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md +++ b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md @@ -29,7 +29,9 @@ Architecture A natural extension to this partitioned federation is to add a layer of software responsible for federating the namespaces. -This extra layer allows users to access any subcluster transparently, lets subclusters manage their own block pools independently, and supports rebalancing of data across subclusters. +This extra layer allows users to access any subcluster transparently, lets subclusters manage their own block pools independently, and will support rebalancing of data across subclusters later +(see more info in [HDFS-13123](https://issues.apache.org/jira/browse/HDFS-13123)). The subclusters in RBF are not required to be the independent HDFS clusters, a normal federation cluster +(with multiple block pools) or a mixed cluster with federation and independent cluster is also allowed. To accomplish these goals, the federation layer directs block accesses to the proper subcluster, maintains the state of the namespaces, and provides mechanisms for data rebalancing. This layer must be scalable, highly available, and fault tolerant. @@ -304,8 +306,8 @@ The connection to the State Store and the internal caching at the Router. | Property | Default | Description| |: |: |: | | dfs.federation.router.store.enable | `true` | If `true`, the Router connects to the State Store. | -| dfs.federation.router.store.serializer | `StateStoreSerializerPBImpl` | Class to serialize State Store records. | -| dfs.federation.router.store.driver.class | `StateStoreZooKeeperImpl` | Class to implement the State Store. | +| dfs.federation.router.store.serializer | `org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreSerializerPBImpl` | Class to serialize State Store records. | +| dfs.federation.router.store.driver.class | `org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreZooKeeperImpl` | Class to implement the State Store. | | dfs.federation.router.store.connection.test | 6 | How often to check for the connection to the State Store in milliseconds. | | dfs.federation.router.cache.ttl | 6 | How often to refresh the State Store caches in milliseconds. | | dfs.federation.router.store.membership.expiration | 30 | Expiration time in milliseconds for a membership record. | @@ -316,8 +318,8 @@ Forwarding client requests to the right subcluster. | Property | Default | Description| |: |: |: | -| dfs.federation.router.file.resolver.client.class | MountTableResolver | Class to resolve files to subclusters. | -| dfs.federation.router.namenode.resolver.client.class | MembershipNamenodeResolver | Class to resolve the namenode for a subcluster. | +| dfs.federation.router.file.resolver.client.class | `org.apache.hadoop.hdfs.server.federation.resolver.MountTableResolver` | Class to resolve files to subclusters. | +| dfs.federation.router.namenode.resolver.client.class | `org.apache.hadoop.hdfs.server.federation.resolver.MembershipNamenodeResolver` | Class to resolve the namenode for a subcluster. | ### Namenode monitoring - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin.
Repository: hadoop Updated Branches: refs/heads/branch-3.1 86a1c8975 -> 60c6ded48 HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin. (cherry picked from commit 4743d4a2c70a213a41804a24c776e6db00e1b90d) Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/60c6ded4 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/60c6ded4 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/60c6ded4 Branch: refs/heads/branch-3.1 Commit: 60c6ded483c6e0ebd93c3c4a261090aea57d92e8 Parents: 86a1c89 Author: Yiqun LinAuthored: Sat Mar 10 11:28:55 2018 +0800 Committer: Yiqun Lin Committed: Sat Mar 10 11:30:52 2018 +0800 -- .../src/site/markdown/HDFSRouterFederation.md | 12 +++- 1 file changed, 7 insertions(+), 5 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/60c6ded4/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md -- diff --git a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md index 5412aae..fdaaa11 100644 --- a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md +++ b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md @@ -29,7 +29,9 @@ Architecture A natural extension to this partitioned federation is to add a layer of software responsible for federating the namespaces. -This extra layer allows users to access any subcluster transparently, lets subclusters manage their own block pools independently, and supports rebalancing of data across subclusters. +This extra layer allows users to access any subcluster transparently, lets subclusters manage their own block pools independently, and will support rebalancing of data across subclusters later +(see more info in [HDFS-13123](https://issues.apache.org/jira/browse/HDFS-13123)). The subclusters in RBF are not required to be the independent HDFS clusters, a normal federation cluster +(with multiple block pools) or a mixed cluster with federation and independent cluster is also allowed. To accomplish these goals, the federation layer directs block accesses to the proper subcluster, maintains the state of the namespaces, and provides mechanisms for data rebalancing. This layer must be scalable, highly available, and fault tolerant. @@ -324,8 +326,8 @@ The connection to the State Store and the internal caching at the Router. | Property | Default | Description| |: |: |: | | dfs.federation.router.store.enable | `true` | If `true`, the Router connects to the State Store. | -| dfs.federation.router.store.serializer | `StateStoreSerializerPBImpl` | Class to serialize State Store records. | -| dfs.federation.router.store.driver.class | `StateStoreZooKeeperImpl` | Class to implement the State Store. | +| dfs.federation.router.store.serializer | `org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreSerializerPBImpl` | Class to serialize State Store records. | +| dfs.federation.router.store.driver.class | `org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreZooKeeperImpl` | Class to implement the State Store. | | dfs.federation.router.store.connection.test | 6 | How often to check for the connection to the State Store in milliseconds. | | dfs.federation.router.cache.ttl | 6 | How often to refresh the State Store caches in milliseconds. | | dfs.federation.router.store.membership.expiration | 30 | Expiration time in milliseconds for a membership record. | @@ -336,8 +338,8 @@ Forwarding client requests to the right subcluster. | Property | Default | Description| |: |: |: | -| dfs.federation.router.file.resolver.client.class | MountTableResolver | Class to resolve files to subclusters. | -| dfs.federation.router.namenode.resolver.client.class | MembershipNamenodeResolver | Class to resolve the namenode for a subcluster. | +| dfs.federation.router.file.resolver.client.class | `org.apache.hadoop.hdfs.server.federation.resolver.MountTableResolver` | Class to resolve files to subclusters. | +| dfs.federation.router.namenode.resolver.client.class | `org.apache.hadoop.hdfs.server.federation.resolver.MembershipNamenodeResolver` | Class to resolve the namenode for a subcluster. | ### Namenode monitoring - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org
hadoop git commit: HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin.
Repository: hadoop Updated Branches: refs/heads/trunk 8133cd530 -> 4743d4a2c HDFS-13240. RBF: Update some inaccurate document descriptions. Contributed by Yiqun Lin. Project: http://git-wip-us.apache.org/repos/asf/hadoop/repo Commit: http://git-wip-us.apache.org/repos/asf/hadoop/commit/4743d4a2 Tree: http://git-wip-us.apache.org/repos/asf/hadoop/tree/4743d4a2 Diff: http://git-wip-us.apache.org/repos/asf/hadoop/diff/4743d4a2 Branch: refs/heads/trunk Commit: 4743d4a2c70a213a41804a24c776e6db00e1b90d Parents: 8133cd5 Author: Yiqun LinAuthored: Sat Mar 10 11:28:55 2018 +0800 Committer: Yiqun Lin Committed: Sat Mar 10 11:28:55 2018 +0800 -- .../src/site/markdown/HDFSRouterFederation.md | 12 +++- 1 file changed, 7 insertions(+), 5 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hadoop/blob/4743d4a2/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md -- diff --git a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md index 5412aae..fdaaa11 100644 --- a/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md +++ b/hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSRouterFederation.md @@ -29,7 +29,9 @@ Architecture A natural extension to this partitioned federation is to add a layer of software responsible for federating the namespaces. -This extra layer allows users to access any subcluster transparently, lets subclusters manage their own block pools independently, and supports rebalancing of data across subclusters. +This extra layer allows users to access any subcluster transparently, lets subclusters manage their own block pools independently, and will support rebalancing of data across subclusters later +(see more info in [HDFS-13123](https://issues.apache.org/jira/browse/HDFS-13123)). The subclusters in RBF are not required to be the independent HDFS clusters, a normal federation cluster +(with multiple block pools) or a mixed cluster with federation and independent cluster is also allowed. To accomplish these goals, the federation layer directs block accesses to the proper subcluster, maintains the state of the namespaces, and provides mechanisms for data rebalancing. This layer must be scalable, highly available, and fault tolerant. @@ -324,8 +326,8 @@ The connection to the State Store and the internal caching at the Router. | Property | Default | Description| |: |: |: | | dfs.federation.router.store.enable | `true` | If `true`, the Router connects to the State Store. | -| dfs.federation.router.store.serializer | `StateStoreSerializerPBImpl` | Class to serialize State Store records. | -| dfs.federation.router.store.driver.class | `StateStoreZooKeeperImpl` | Class to implement the State Store. | +| dfs.federation.router.store.serializer | `org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreSerializerPBImpl` | Class to serialize State Store records. | +| dfs.federation.router.store.driver.class | `org.apache.hadoop.hdfs.server.federation.store.driver.impl.StateStoreZooKeeperImpl` | Class to implement the State Store. | | dfs.federation.router.store.connection.test | 6 | How often to check for the connection to the State Store in milliseconds. | | dfs.federation.router.cache.ttl | 6 | How often to refresh the State Store caches in milliseconds. | | dfs.federation.router.store.membership.expiration | 30 | Expiration time in milliseconds for a membership record. | @@ -336,8 +338,8 @@ Forwarding client requests to the right subcluster. | Property | Default | Description| |: |: |: | -| dfs.federation.router.file.resolver.client.class | MountTableResolver | Class to resolve files to subclusters. | -| dfs.federation.router.namenode.resolver.client.class | MembershipNamenodeResolver | Class to resolve the namenode for a subcluster. | +| dfs.federation.router.file.resolver.client.class | `org.apache.hadoop.hdfs.server.federation.resolver.MountTableResolver` | Class to resolve files to subclusters. | +| dfs.federation.router.namenode.resolver.client.class | `org.apache.hadoop.hdfs.server.federation.resolver.MembershipNamenodeResolver` | Class to resolve the namenode for a subcluster. | ### Namenode monitoring - To unsubscribe, e-mail: common-commits-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-commits-h...@hadoop.apache.org