Alexey Serbin has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/18924 )
Change subject: [bootstrap] Reduce the memory size consumed when bootstrap ...................................................................... [bootstrap] Reduce the memory size consumed when bootstrap When a tserver bootstraps, it loads all tablets metadata, and finds out the maximum fs block id it has seen to notify the block manager to avoid generating duplicate ids. However, a tablet may contain a large number of blocks, that means it consumes a large amount of memory when tablets parellel loaded when tserver bootstrap. This patch optimizes the tablet bootstrap to find the maximum block id for a tablet without storing all the block identifiers in the memory. Change-Id: If4df35f63e99a3f8331da51114991515ea4ee496 Reviewed-on: http://gerrit.cloudera.org:8080/18924 Tested-by: Yingchun Lai <[email protected]> Reviewed-by: Alexey Serbin <[email protected]> --- M src/kudu/tablet/rowset_metadata.cc M src/kudu/tablet/rowset_metadata.h M src/kudu/tablet/tablet_metadata-test.cc M src/kudu/tablet/tablet_metadata.cc M src/kudu/tablet/tablet_metadata.h 5 files changed, 71 insertions(+), 16 deletions(-) Approvals: Yingchun Lai: Verified Alexey Serbin: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/18924 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: If4df35f63e99a3f8331da51114991515ea4ee496 Gerrit-Change-Number: 18924 Gerrit-PatchSet: 5 Gerrit-Owner: Yingchun Lai <[email protected]> Gerrit-Reviewer: Alexey Serbin <[email protected]> Gerrit-Reviewer: Kudu Jenkins (120) Gerrit-Reviewer: Tidy Bot (241) Gerrit-Reviewer: Yifan Zhang <[email protected]> Gerrit-Reviewer: Yingchun Lai <[email protected]>
