Hello Attila Bukor, Kudu Jenkins, Andrew Wong, Abhishek Chennaka,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/18308
to look at the new patch set (#3).
Change subject: [tools] run intra-location rebalancing in parallel
......................................................................
[tools] run intra-location rebalancing in parallel
This patch addresses TODO in RebalancerTool::Run() to run intra-location
rebalancing in parallel for location-aware Kudu cluster. Since the
location assignment provides an invariant for a tablet server to be only
in one location, a locatation-aware Kudu cluster automatically consists
of non-intersecting set of tablet servers. With that, it's possible to
independently move replicas within different locations while satisfying
various run-time properties, e.g. set by --max_moves_per_server and
other flags.
The new binary was tested on a large production cluster where location
awareness was enabled and it did significantly speed up the rebalancing
process. Running the binary in my test cluster showed significant
reduction of run times as well. Theoretically, running intra-location
rebalancing in parallel might shorten the runtime by N times compared
with running sequentially, where N is the number of locations
in a Kudu cluster.
Change-Id: Ie4fe3ef3ec2fcac57114c97d5b6cd81d5d9953c4
---
M src/kudu/rebalance/rebalancer.cc
M src/kudu/rebalance/rebalancer.h
M src/kudu/tools/rebalancer_tool-test.cc
M src/kudu/tools/rebalancer_tool.cc
M src/kudu/tools/rebalancer_tool.h
M src/kudu/tools/tool_action_cluster.cc
6 files changed, 191 insertions(+), 28 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/08/18308/3
--
To view, visit http://gerrit.cloudera.org:8080/18308
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ie4fe3ef3ec2fcac57114c97d5b6cd81d5d9953c4
Gerrit-Change-Number: 18308
Gerrit-PatchSet: 3
Gerrit-Owner: Alexey Serbin <[email protected]>
Gerrit-Reviewer: Abhishek Chennaka <[email protected]>
Gerrit-Reviewer: Alexey Serbin <[email protected]>
Gerrit-Reviewer: Andrew Wong <[email protected]>
Gerrit-Reviewer: Attila Bukor <[email protected]>
Gerrit-Reviewer: Kudu Jenkins (120)
