Hello Marton Greber, Kudu Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/22708
to look at the new patch set (#3).
Change subject: [compaction] Add memory tracking for better OOM issues triaging
......................................................................
[compaction] Add memory tracking for better OOM issues triaging
This patch adds memory accounting for RowSet compaction.
The memory usage is tracked under newly added MemTracker.
The tracker is added per rowset compaction operation. The same
tracker is shared across multiple compaction inputs that are
involved in that specific compaction operation. Each input
has its own usage added to shared memory tracker during the
initialisation and is deducted in corresponding destructor.
Along with that, throttled warning messages are added when the
memory usage goes beyond a certain threshold.
A unit test is added to verify the presence of warning messages
when memory threshold (reduced for test purpose) is crossed.
Change-Id: I700fdf5ee0fbf0f2826b863d23d599f03ad4ac49
---
M src/kudu/tablet/compaction-highmem-test.cc
M src/kudu/tablet/compaction-test.cc
M src/kudu/tablet/compaction.cc
M src/kudu/tablet/compaction.h
M src/kudu/tablet/delta_compaction.cc
M src/kudu/tablet/diskrowset.cc
M src/kudu/tablet/diskrowset.h
M src/kudu/tablet/memrowset.cc
M src/kudu/tablet/memrowset.h
M src/kudu/tablet/mock-rowsets.h
M src/kudu/tablet/rowset.cc
M src/kudu/tablet/rowset.h
M src/kudu/tablet/tablet.cc
13 files changed, 229 insertions(+), 40 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/08/22708/3
--
To view, visit http://gerrit.cloudera.org:8080/22708
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I700fdf5ee0fbf0f2826b863d23d599f03ad4ac49
Gerrit-Change-Number: 22708
Gerrit-PatchSet: 3
Gerrit-Owner: Ashwani Raina <[email protected]>
Gerrit-Reviewer: Ashwani Raina <[email protected]>
Gerrit-Reviewer: Kudu Jenkins (120)
Gerrit-Reviewer: Marton Greber <[email protected]>
