Yingchun Lai has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/17837 )
Change subject: KUDU-3318 [fs] Add size limit for log block container metadata ...................................................................... KUDU-3318 [fs] Add size limit for log block container metadata In some cases, log block container's data file is very small after punching hole, while metadata file is relatively large because it contains many CREATE-DELETE pairs. LBM reclaims both .data and corresponding .metadata container files when the .data container file becomes full (i.e. reaches its size or block count threshold). So, the .metadata container file might grow without any limit before the .data container becomes full. This patch adds a size limit for log block container's metadata, taking it into account while determining the container's 'full' condition. That gives the LBM an opportunity to reclaim the disk space once the container becomes full. Change-Id: I12513abf2e45f7bdf091142c31f50d650b6f0cfc Reviewed-on: http://gerrit.cloudera.org:8080/17837 Tested-by: Kudu Jenkins Reviewed-by: Alexey Serbin <aser...@cloudera.com> Reviewed-by: Andrew Wong <aw...@cloudera.com> --- M src/kudu/fs/log_block_manager-test.cc M src/kudu/fs/log_block_manager.cc M src/kudu/util/pb_util.cc M src/kudu/util/pb_util.h 4 files changed, 57 insertions(+), 3 deletions(-) Approvals: Kudu Jenkins: Verified Alexey Serbin: Looks good to me, approved Andrew Wong: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/17837 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I12513abf2e45f7bdf091142c31f50d650b6f0cfc Gerrit-Change-Number: 17837 Gerrit-PatchSet: 9 Gerrit-Owner: Yingchun Lai <acelyc1112...@gmail.com> Gerrit-Reviewer: Alexey Serbin <aser...@cloudera.com> Gerrit-Reviewer: Andrew Wong <aw...@cloudera.com> Gerrit-Reviewer: Kudu Jenkins (120) Gerrit-Reviewer: Tidy Bot (241) Gerrit-Reviewer: Yingchun Lai <acelyc1112...@gmail.com>
