Memory efficient compactions
-----------------------------
Key: CASSANDRA-16
URL: https://issues.apache.org/jira/browse/CASSANDRA-16
Project: Cassandra
Issue Type: Improvement
Environment: All
Reporter: Sandeep Tata
The basic idea is to allow rows to get large enough that they don't have to fit
in memory entirely, but can easily fit on a disk. The compaction algorithm
today de-serializes the entire row in memory before writing out the compacted
SSTable (see ColumnFamilyStore.doCompaction() and associated methods).
The requirement is to have a compaction method with a lower memory requirement
so we can support rows larger than available main memory. To re-use the old FB
example, if we stored a user's inbox in a row, we'd want the inbox to grow
bigger than memory so long as it fit on disk.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
