Ashwani Raina has uploaded this change for review. (
http://gerrit.cloudera.org:8080/24412
Change subject: KUDU-3429 Add extensive test for delta generation (3/n)
......................................................................
KUDU-3429 Add extensive test for delta generation (3/n)
The patch adds a unit test that is a better version of existing tests
to generate UNDO deltas using:
* Pattern of inserting interleaved rows to ensure more rowsets become
eligibile for compaction.
* Wide column data to make each mutation size big enough (1KB). Along
with repetitive updates ensures increased delta memory footprint.
* Increased rows per block batch size that ensures compaction op has
more memory footprint, used to hold rowblock and their mutations.
* Use pseudo-random byte pattern to minimize the effect of compression.
If there are repeated characters, compression would bring memory
requirements of a CFile block memory to a minimum, keeping RSS flat
during compaction.
* This can act as a defacto unit test for testing high memory compaction
ops. Any specific use cases can use this as reference base test.
This changelist doesn't contain any functional modifications.
Note: There are a couple of TODOs for uncommenting usage of the flag
FLAGS_compaction_rows_per_block that is introduced in unmerged
patch: https://gerrit.cloudera.org/#/c/24328/. Once the patch is
merged, flag use can be enabled here.
Change-Id: I8c337dba87a9d1cf549f9b53813da8d50e86b6b4
---
M src/kudu/tablet/compaction-highmem-test.cc
M src/kudu/tablet/tablet.h
2 files changed, 272 insertions(+), 0 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/12/24412/1
--
To view, visit http://gerrit.cloudera.org:8080/24412
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I8c337dba87a9d1cf549f9b53813da8d50e86b6b4
Gerrit-Change-Number: 24412
Gerrit-PatchSet: 1
Gerrit-Owner: Ashwani Raina <[email protected]>
