Hello Kudu Jenkins, Andrew Wong, Hao Hao,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/15830
to look at the new patch set (#6).
Change subject: [fs] limit memory could consume compacting low live ratio
blocks during startup
......................................................................
[fs] limit memory could consume compacting low live ratio blocks during startup
During tserver startup, it loads all blocks of low live ratio metadata into
memory for compacting, and the memory behave is not under control of
FLAGS_memory_limit_hard_bytes.
To those tservers which didn't compact well due to starvation of
compaction, the metadata files inflated, size of all metadata files increases
and may result in OOM in next startup. Sometimes the memory consumption for
startup may exceed physical memory.
E.g. In a node with 32G physical memory, we found about 90GiB metatatada
files, to load all the low live ratio blocks into memory may take over
50g memory. It's far exceeds the memory limit of kudu and even physical
limit. Once it failed due to some reason or restart it manually, it may
never make it startup.
Here introduce FlAGS_max_limit_hard_bytes_low_live_ratio_blocks_compacting to
limit the memory may take by compacting low live blocks.
Change-Id: Ifad1d6de4e61a1ddcfb35743abd71b57d6418896
---
M src/kudu/fs/log_block_manager.cc
M src/kudu/fs/log_block_manager.h
2 files changed, 16 insertions(+), 2 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/30/15830/6
--
To view, visit http://gerrit.cloudera.org:8080/15830
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ifad1d6de4e61a1ddcfb35743abd71b57d6418896
Gerrit-Change-Number: 15830
Gerrit-PatchSet: 6
Gerrit-Owner: wangning <[email protected]>
Gerrit-Reviewer: Andrew Wong <[email protected]>
Gerrit-Reviewer: Hao Hao <[email protected]>
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: wangning <[email protected]>
