David Ribeiro Alves has posted comments on this change. Change subject: KUDU-1601. Delete ancient UNDO delta blocks in the background ......................................................................
Patch Set 20: Code-Review+2 (1 comment) http://gerrit.cloudera.org:8080/#/c/4363/20//COMMIT_MSG Commit Message: PS20, Line 74: * I ran 300 iterations of TabletHistoryGcITest.TestUndoDeltaBlockGc on : the dist-test cluster under TSAN with 12 stress threads: : http://dist-test.cloudera.org/job?job_id=mpercy.1487901212.3733 : : * I also ran YCSB on a 10-node cluster on a table with 200 tablets with : mostly default parameters except for --tablet_history_max_age_sec=60. : YCSB was configured like so: : : recordcount=100000 : operationcount=6000000 : updateproportion=1.0 : requestdistribution=zipfian : threadcount=10 : kudu_pre_split_num_tablets=200 : kudu_sync_ops=true : : This workload took 839 seconds to run and I did not observe an average : update latency increase over time (there was a mild sawtooth pattern), : which indicated to me that the compaction operations were keeping up : with the updates. The undo delta GC operations were also keeping pace : and garbage was being collected aggressively, with generally only tens : of MB, or less, of reclaimable data per tablet being present at any : given time. It seems the current defaults are reasonable, although : additional performance testing is likely warranted. thanks for doing this. -- To view, visit http://gerrit.cloudera.org:8080/4363 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I0309bf7acfb6d018860c80f354012c3500da5c68 Gerrit-PatchSet: 20 Gerrit-Project: kudu Gerrit-Branch: master Gerrit-Owner: Mike Percy <mpe...@apache.org> Gerrit-Reviewer: Adar Dembo <a...@cloudera.com> Gerrit-Reviewer: David Ribeiro Alves <dral...@apache.org> Gerrit-Reviewer: Jean-Daniel Cryans <jdcry...@apache.org> Gerrit-Reviewer: Mike Percy <mpe...@apache.org> Gerrit-Reviewer: Tidy Bot Gerrit-HasComments: Yes