[
https://issues.apache.org/jira/browse/CASSANDRA-847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stu Hood updated CASSANDRA-847:
-------------------------------
Attachment: 0010-Alternative-to-ReducingIterator-that-can-return-mult.patch
I managed to keep 0007-0010 fairly separated, but I can't imagine a good way to
rebase this into the original patch set.
All Scanners now extend Iterator again, and Compaction extends a new
MergingIterator class.
The MergingIterator class is almost a copy-paste of ReducingIterator, but it
changes the return type of getReduced to an Iterator, and I didn't think we'd
want to incur that overhead for other ReducingIterators.
Compaction is completely memory efficient now: the actual collection into an
IteratingRow/CompactedRow happens externally in CompactionManager, so it will
be easy to remove.
> Make the reading half of compactions memory-efficient
> -----------------------------------------------------
>
> Key: CASSANDRA-847
> URL: https://issues.apache.org/jira/browse/CASSANDRA-847
> Project: Cassandra
> Issue Type: Improvement
> Reporter: Stu Hood
> Priority: Critical
> Fix For: 0.7
>
> Attachments:
> 0001-Add-structures-that-were-important-to-the-SSTableSca.patch,
> 0002-Implement-most-of-the-new-SSTableScanner-interface.patch,
> 0003-Rename-RowIndexedReader-specific-test.patch,
> 0004-Improve-Scanner-tests-and-separate-SuperCF-handling-.patch,
> 0005-Add-Scanner-interface-and-a-Filtered-implementation-.patch,
> 0006-Add-support-for-compaction-of-super-CFs-and-some-tes.patch,
> 0007-Remove-ColumnKey-bloom-filter-maintenance.patch,
> 0008-Make-Scanner-extend-Iterator-again.patch,
> 0009-Make-CompactionIterator-a-ReducingIterator-subclass-.patch,
> 0010-Alternative-to-ReducingIterator-that-can-return-mult.patch
>
>
> This issue is the next on the road to finally fixing CASSANDRA-16. To make
> compactions memory efficient, we have to be able to perform the compaction
> process on the smallest possible chunks that might intersect and contend
> one-another, meaning that we need a better abstraction for reading from
> SSTables.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
