Alexey Serbin has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/18308 )
Change subject: [tools] run intra-location rebalancing in parallel ...................................................................... [tools] run intra-location rebalancing in parallel This patch addresses TODO in RebalancerTool::Run() to run intra-location rebalancing in parallel for location-aware Kudu cluster. Since the location assignment provides an invariant for a tablet server to be only in one location, a locatation-aware Kudu cluster automatically consists of non-intersecting set of tablet servers. With that, it's possible to independently move replicas within different locations while satisfying various run-time properties, e.g. set by --max_moves_per_server and other flags. The new binary was tested on a large production cluster where location awareness was enabled and it did significantly speed up the rebalancing process. Running the binary in my test cluster showed significant reduction of run times as well. Theoretically, running intra-location rebalancing in parallel might shorten the runtime by N times compared with running sequentially, where N is the number of locations in a Kudu cluster. Change-Id: Ie4fe3ef3ec2fcac57114c97d5b6cd81d5d9953c4 Reviewed-on: http://gerrit.cloudera.org:8080/18308 Tested-by: Alexey Serbin <[email protected]> Reviewed-by: Alexey Serbin <[email protected]> --- M src/kudu/rebalance/rebalancer.cc M src/kudu/rebalance/rebalancer.h M src/kudu/tools/rebalancer_tool-test.cc M src/kudu/tools/rebalancer_tool.cc M src/kudu/tools/rebalancer_tool.h M src/kudu/tools/tool_action_cluster.cc 6 files changed, 191 insertions(+), 28 deletions(-) Approvals: Alexey Serbin: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/18308 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: Ie4fe3ef3ec2fcac57114c97d5b6cd81d5d9953c4 Gerrit-Change-Number: 18308 Gerrit-PatchSet: 4 Gerrit-Owner: Alexey Serbin <[email protected]> Gerrit-Reviewer: Abhishek Chennaka <[email protected]> Gerrit-Reviewer: Alexey Serbin <[email protected]> Gerrit-Reviewer: Andrew Wong <[email protected]> Gerrit-Reviewer: Attila Bukor <[email protected]> Gerrit-Reviewer: Kudu Jenkins (120)
