wangning has uploaded this change for review. ( http://gerrit.cloudera.org:8080/15830
Change subject: [fs] fixed file num low live ratio metadata compaction policy when startup ...................................................................... [fs] fixed file num low live ratio metadata compaction policy when startup During tserver startup, it loads all low live ratio metadata into memory, and this is not under controll of --memory_limit_hard_bytes. To those tservers which didn't compact well due to starvation of compaction, the metadata files inflated, num of metadata files increases and may result in OOM in next time startup. Passing the --log_container_live_metadata_before_compact_ratio would help limit the memory consumptio when startup. To limit the memory consumption of livemetadata compaction, we always use --log_container_live_metadata_before_compact_ratio would help. But it is not flexible cause we have no idea about the distribution of live ratio of blocks. Limit the num of metadata files to be compacted could help avoid OOM. Change-Id: Ifad1d6de4e61a1ddcfb35743abd71b57d6418896 --- M src/kudu/fs/log_block_manager.cc M src/kudu/fs/log_block_manager.h 2 files changed, 13 insertions(+), 2 deletions(-) git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/30/15830/1 -- To view, visit http://gerrit.cloudera.org:8080/15830 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: Ifad1d6de4e61a1ddcfb35743abd71b57d6418896 Gerrit-Change-Number: 15830 Gerrit-PatchSet: 1 Gerrit-Owner: wangning <[email protected]>
