Hello Tidy Bot, Alexey Serbin, Kudu Jenkins, Andrew Wong,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/14177
to look at the new patch set (#23).
Change subject: KUDU-2780: create thread for auto-rebalancing
......................................................................
KUDU-2780: create thread for auto-rebalancing
The auto-rebalancer thread is a background task of
the master's catalog manager. Each loop iteration, the
thread collects information on tablet servers, tables,
and tablets, in order to determine the best rebalancing
replica moves for the current state of the cluster.
The maximum number of moves per tserver, per iteration,
is controlled by a flag. Currently, each batch of moves
scheduled per iteration is executed synchronously. The
thread waits for the moves to complete, then sleeps for a
time interval, which is controlled by a flag, before resuming.
If the cluster has placement policy violations, the thread
will prioritize scheduling and executing replica moves to
reinstate the policy. Otherwise, the thread will perform
inter-location (cross-location), then intra-location (by
table, then by tserver) rebalancing.
By default, auto-rebalancing is disabled. This can be
changed by a flag in the catalog manager. The rebalancer
tool should be run first, to fully rebalance the cluster,
before enabling auto-rebalancing.
Change-Id: Ifca25d1063c07047cf2123e6792b3c7395be20e4
---
M src/kudu/master/CMakeLists.txt
A src/kudu/master/auto_rebalancer-test.cc
A src/kudu/master/auto_rebalancer.cc
A src/kudu/master/auto_rebalancer.h
M src/kudu/master/catalog_manager.cc
M src/kudu/master/catalog_manager.h
M src/kudu/master/master_runner.cc
M src/kudu/master/ts_descriptor.h
M src/kudu/master/ts_manager.cc
M src/kudu/master/ts_manager.h
M src/kudu/rebalance/rebalancer.cc
M src/kudu/rebalance/rebalancer.h
M src/kudu/tools/rebalancer_tool.cc
M src/kudu/tools/tool_replica_util.cc
M src/kudu/tools/tool_replica_util.h
15 files changed, 1,735 insertions(+), 107 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/77/14177/23
--
To view, visit http://gerrit.cloudera.org:8080/14177
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ifca25d1063c07047cf2123e6792b3c7395be20e4
Gerrit-Change-Number: 14177
Gerrit-PatchSet: 23
Gerrit-Owner: Hannah Nguyen <hannah.ngu...@cloudera.com>
Gerrit-Reviewer: Alexey Serbin <aser...@cloudera.com>
Gerrit-Reviewer: Andrew Wong <aw...@cloudera.com>
Gerrit-Reviewer: Hannah Nguyen <hannah.ngu...@cloudera.com>
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Tidy Bot (241)
