David Ribeiro Alves has posted comments on this change.

Change subject: KUDU-1601. Delete ancient UNDO delta blocks in the background
......................................................................


Patch Set 20: Code-Review+2

(1 comment)

http://gerrit.cloudera.org:8080/#/c/4363/20//COMMIT_MSG
Commit Message:

PS20, Line 74: * I ran 300 iterations of 
TabletHistoryGcITest.TestUndoDeltaBlockGc on
             :   the dist-test cluster under TSAN with 12 stress threads:
             :   http://dist-test.cloudera.org/job?job_id=mpercy.1487901212.3733
             : 
             : * I also ran YCSB on a 10-node cluster on a table with 200 
tablets with
             :   mostly default parameters except for 
--tablet_history_max_age_sec=60.
             :   YCSB was configured like so:
             : 
             :     recordcount=100000
             :     operationcount=6000000
             :     updateproportion=1.0
             :     requestdistribution=zipfian
             :     threadcount=10
             :     kudu_pre_split_num_tablets=200
             :     kudu_sync_ops=true
             : 
             :   This workload took 839 seconds to run and I did not observe an 
average
             :   update latency increase over time (there was a mild sawtooth 
pattern),
             :   which indicated to me that the compaction operations were 
keeping up
             :   with the updates. The undo delta GC operations were also 
keeping pace
             :   and garbage was being collected aggressively, with generally 
only tens
             :   of MB, or less, of reclaimable data per tablet being present 
at any
             :   given time. It seems the current defaults are reasonable, 
although
             :   additional performance testing is likely warranted.
thanks for doing this.


-- 
To view, visit http://gerrit.cloudera.org:8080/4363
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I0309bf7acfb6d018860c80f354012c3500da5c68
Gerrit-PatchSet: 20
Gerrit-Project: kudu
Gerrit-Branch: master
Gerrit-Owner: Mike Percy <mpe...@apache.org>
Gerrit-Reviewer: Adar Dembo <a...@cloudera.com>
Gerrit-Reviewer: David Ribeiro Alves <dral...@apache.org>
Gerrit-Reviewer: Jean-Daniel Cryans <jdcry...@apache.org>
Gerrit-Reviewer: Mike Percy <mpe...@apache.org>
Gerrit-Reviewer: Tidy Bot
Gerrit-HasComments: Yes

Reply via email to