[
https://issues.apache.org/jira/browse/CASSANDRA-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Russell Alexander Spitzer updated CASSANDRA-5547:
-------------------------------------------------
Attachment: cassandra-2.0-5547.txt
Thought I would make an attempt at this. Made all three operations request a
thread per file. I would be glad to make any changes/improvements requested.
Example of multithreaded scrubbing
{code}
INFO [CompactionExecutor:29] 2014-03-22 14:29:30,783 OutputHandler.java (line
42) Scrubbing
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-jb-38-Data.db')
(18061938 bytes)
INFO [CompactionExecutor:26] 2014-03-22 14:29:30,783 OutputHandler.java (line
42) Scrubbing
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-jb-40-Data.db')
(110006268 bytes)
INFO [CompactionExecutor:28] 2014-03-22 14:29:30,783 OutputHandler.java (line
42) Scrubbing
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-jb-32-Data.db')
(99237382 bytes)
INFO [CompactionExecutor:25] 2014-03-22 14:29:30,783 OutputHandler.java (line
42) Scrubbing
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-jb-23-Data.db')
(76191460 bytes)
INFO [CompactionExecutor:32] 2014-03-22 14:29:30,783 OutputHandler.java (line
42) Scrubbing
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-jb-27-Data.db')
(189539010 bytes)
INFO [CompactionExecutor:31] 2014-03-22 14:29:30,783 OutputHandler.java (line
42) Scrubbing
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-jb-37-Data.db')
(27822796 bytes)
INFO [CompactionExecutor:30] 2014-03-22 14:29:30,783 OutputHandler.java (line
42) Scrubbing
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-jb-39-Data.db')
(29473004 bytes)
INFO [CompactionExecutor:29] 2014-03-22 14:29:37,391 OutputHandler.java (line
42) Scrub of
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-jb-38-Data.db')
complete: 64971 rows in new sstable and 0 empty (tombstoned) rows dropped
INFO [CompactionExecutor:31] 2014-03-22 14:29:40,882 OutputHandler.java (line
42) Scrub of
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-jb-37-Data.db')
complete: 100082 rows in new sstable and 0 empty (tombstoned) rows dropped
INFO [CompactionExecutor:30] 2014-03-22 14:29:41,383 OutputHandler.java (line
42) Scrub of
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-jb-39-Data.db')
complete: 106018 rows in new sstable and 0 empty (tombstoned) rows dropped
INFO [CompactionExecutor:25] 2014-03-22 14:29:52,562 OutputHandler.java (line
42) Scrub of
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-jb-23-Data.db')
complete: 274070 rows in new sstable and 0 empty (tombstoned) rows dropped
INFO [CompactionExecutor:28] 2014-03-22 14:29:56,753 OutputHandler.java (line
42) Scrub of
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-jb-32-Data.db')
complete: 356969 rows in new sstable and 0 empty (tombstoned) rows dropped
INFO [CompactionExecutor:26] 2014-03-22 14:29:58,021 OutputHandler.java (line
42) Scrub of
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-jb-40-Data.db')
complete: 395706 rows in new sstable and 0 empty (tombstoned) rows dropped
INFO [CompactionExecutor:32] 2014-03-22 14:30:02,841 OutputHandler.java (line
42) Scrub of
SSTableReader(path='/var/lib/cassandra/data/Keyspace1/Standard1/Keyspace1-Standard1-jb-27-Data.db')
complete: 681795 rows in new sstable and 0 empty (tombstoned) rows dropped
{code}
> Multi-threaded scrub
> --------------------
>
> Key: CASSANDRA-5547
> URL: https://issues.apache.org/jira/browse/CASSANDRA-5547
> Project: Cassandra
> Issue Type: Improvement
> Components: Tools
> Reporter: Benjamin Coverston
> Labels: lhf
> Attachments: cassandra-2.0-5547.txt
>
>
> Scrub (especially offline) could benefit from being multi-threaded,
> especially in the case where the SSTables are compressed.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
