This is an automated email from the ASF dual-hosted git repository.
wchevreuil pushed a change to branch HBASE-27389-rebase
in repository https://gitbox.apache.org/repos/asf/hbase.git
from 23c41560d58 HBASE-24687: Use existing HMaster Connection in
MobFileCleanerChore (#5509)
new f6a276ab018 HBASE-27997 Enhance prefetch executor to record region
prefetch infor… (#5339)
new 993326e147d HBASE-27998 Enhance region metrics to include prefetch
ratio for each… (#5342)
new ecb756f7ffd HBASE-27999 Implement cache prefetch aware load balancer
(#5376)
new 591e01b2dd8 HBASE-28097 Add documentation section for the Cache Aware
balancer fu… (#5495)
The 4 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../master/balancer/BalancerClusterState.java | 156 ++++++-
.../hbase/master/balancer/BalancerRegionLoad.java | 12 +
.../hbase/master/balancer/BaseLoadBalancer.java | 3 +-
.../master/balancer/CacheAwareLoadBalancer.java | 479 +++++++++++++++++++++
.../master/balancer/StochasticLoadBalancer.java | 54 ++-
.../hbase/master/balancer/BalancerTestBase.java | 14 +
.../balancer/TestStochasticLoadBalancer.java | 4 +
.../org/apache/hadoop/hbase/RegionMetrics.java | 6 +
.../apache/hadoop/hbase/RegionMetricsBuilder.java | 38 +-
.../org/apache/hadoop/hbase/ServerMetrics.java | 6 +
.../apache/hadoop/hbase/ServerMetricsBuilder.java | 20 +-
.../java/org/apache/hadoop/hbase/HConstants.java | 12 +
.../src/main/protobuf/PrefetchPersistence.proto | 31 --
.../src/main/protobuf/server/ClusterStatus.proto | 11 +
.../main/protobuf/server/io/BucketCacheEntry.proto | 8 +-
.../apache/hadoop/hbase/io/hfile/BlockCache.java | 3 +-
.../hadoop/hbase/io/hfile/BlockCacheFactory.java | 13 +-
.../hadoop/hbase/io/hfile/CombinedBlockCache.java | 3 +-
.../hadoop/hbase/io/hfile/HFilePreadReader.java | 12 +-
.../hadoop/hbase/io/hfile/PrefetchProtoUtils.java | 33 --
.../hadoop/hbase/io/hfile/bucket/BucketCache.java | 88 +++-
.../hbase/io/hfile/bucket/BucketProtoUtils.java | 26 +-
.../hadoop/hbase/regionserver/HRegionServer.java | 40 +-
.../org/apache/hadoop/hbase/TestServerMetrics.java | 18 +-
.../hbase/master/TestRegionsRecoveryChore.java | 14 +
.../balancer/TestCacheAwareLoadBalancer.java | 397 +++++++++++++++++
.../TestCacheAwareLoadBalancerCostFunctions.java | 316 ++++++++++++++
...lancerWithStochasticLoadBalancerAsInternal.java | 2 +
src/main/asciidoc/_chapters/architecture.adoc | 43 ++
29 files changed, 1731 insertions(+), 131 deletions(-)
create mode 100644
hbase-balancer/src/main/java/org/apache/hadoop/hbase/master/balancer/CacheAwareLoadBalancer.java
delete mode 100644
hbase-protocol-shaded/src/main/protobuf/PrefetchPersistence.proto
delete mode 100644
hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/PrefetchProtoUtils.java
create mode 100644
hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestCacheAwareLoadBalancer.java
create mode 100644
hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestCacheAwareLoadBalancerCostFunctions.java
