Luo Chen has posted comments on this change. Change subject: Avoid always merging old components in prefix policy ......................................................................
Patch Set 5: Hi reviewers, Here is some experiment results for this change (not very thorough). The experiments were done based on Cloudberry twitter dataset, and the dataset has 6 secondary indexes. The AsterixDB was using default configuration based on NCService. Each experiment keeps ingesting data for one hour, and I recorded the number of tweets ingested. The results are as below: MaxMergeableSize Prefix Prefix with Size Factor 128M 7.11M 8.32M 512M 4.75M 7.77M 1024M 4.38M 7.71M Basically, it always out-performs the prefix policy, and, more importantly, it makes the ingestion more robust w.r.t. MaxMergeableSize -- To view, visit https://asterix-gerrit.ics.uci.edu/1818 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: comment Gerrit-Change-Id: I464da3fed38cded0aee7b319a35664eae069a2ba Gerrit-PatchSet: 5 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Luo Chen <[email protected]> Gerrit-Reviewer: Ian Maxon <[email protected]> Gerrit-Reviewer: Jenkins <[email protected]> Gerrit-Reviewer: Jianfeng Jia <[email protected]> Gerrit-Reviewer: Luo Chen <[email protected]> Gerrit-Reviewer: Yingyi Bu <[email protected]> Gerrit-Reviewer: abdullah alamoudi <[email protected]> Gerrit-HasComments: No
