RemoveDeleted dominates compaction time for large sstable counts
----------------------------------------------------------------
Key: CASSANDRA-3855
URL: https://issues.apache.org/jira/browse/CASSANDRA-3855
Project: Cassandra
Issue Type: Bug
Components: Core
Affects Versions: 1.1
Reporter: Stu Hood
Priority: Critical
Attachments: with-cleaning-java.hprof.txt
With very large numbers of sstables (2000+ generated by a `bin/stress -n
100,000,000` run with LeveledCompactionStrategy),
PrecompactedRow.removeDeletedAndOldShards dominates compaction runtime, such
that commenting it out takes compaction throughput from 200KB/s to 12MB/s.
Stack attached.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
