[
https://issues.apache.org/jira/browse/CASSANDRA-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13003048#comment-13003048
]
Stu Hood commented on CASSANDRA-1472:
-------------------------------------
Sounds reasonable, but there is more to think about for the format. And to
reiterate: I really don't think we should be going down this path.
> What am I missing?
You'll need to put some thought into how blocks will be recorded in the file:
each block would need the equivalent of opening a new (Lucene)
ChecksumIndexInput, because you need to be able to checksum at a smaller
granularity than "the entire stream".
Also, the Lucene classes don't give any thought to compression, so you need to
consider where in the stack you will add it. The compressed data should likely
be checksummed, rather than the raw data, so I think you'll need to port the
LZF code to fit in the stack between the caller and the checksumming.
> Add bitmap secondary indexes
> ----------------------------
>
> Key: CASSANDRA-1472
> URL: https://issues.apache.org/jira/browse/CASSANDRA-1472
> Project: Cassandra
> Issue Type: Improvement
> Components: Core
> Reporter: Stu Hood
> Assignee: Stu Hood
> Fix For: 0.7.4
>
> Attachments: 0.7-1472-v5.tgz, 0.7-1472-v6.tgz,
> 0001-CASSANDRA-1472-rebased-to-0.7-branch.txt,
> 0019-Rename-bugfixes-and-fileclose.txt, 1472-v3.tgz, 1472-v4.tgz,
> 1472-v5.tgz, anatomy.png, v4-bench-c32.txt
>
>
> Bitmap indexes are a very efficient structure for dealing with immutable
> data. We can take advantage of the fact that SSTables are immutable by
> attaching them directly to SSTables as a new component (supported by
> CASSANDRA-1471).
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira