[
https://issues.apache.org/jira/browse/CASSANDRA-11348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993091#comment-15993091
]
Romain Hardouin commented on CASSANDRA-11348:
---------------------------------------------
I have already needed this feature, this is interesting and useful.
The concern when purging data (I mean physically delete) is repair (read repair
or maintenance repair), we must use tombstones to avoid data resurrection. One
of my use case is to purge counters that are older than a specific timestamp.
I also imagined a filter that put tombstones on data and produce backup
sstables corresponding to tombstone'd data. This would allow easy restore in
case of problems.
Another use case would be to plug a small filter that just logs keys when a key
is greater than a specific size but less than
{{compaction_large_partition_warning_threshold_mb}}. It would allow to easily
find outliers.
> Compaction Filter in Cassandra
> ------------------------------
>
> Key: CASSANDRA-11348
> URL: https://issues.apache.org/jira/browse/CASSANDRA-11348
> Project: Cassandra
> Issue Type: New Feature
> Components: Compaction
> Reporter: Dikang Gu
> Assignee: Dikang Gu
> Priority: Minor
> Fix For: 4.x
>
>
> RocksDB has the feature called "Compaction Filter" to allow application to
> modify/delete a key-value during the background compaction.
> https://github.com/facebook/rocksdb/blob/v4.1/include/rocksdb/options.h#L201-L226
> It could be valuable to implement this feature in C* as well.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org
