[ 
https://issues.apache.org/jira/browse/CASSANDRA-11179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Marcus Eriksson updated CASSANDRA-11179:
----------------------------------------
         Assignee: Marcus Eriksson  (was: T Jake Luciani)
         Reviewer: Carl Yeksigian  (was: Marcus Eriksson)
    Fix Version/s: 3.x
                   2.2.x
                   2.1.x
           Status: Patch Available  (was: Open)

patch to add an --seq option to scrub/upgradesstables/cleanup to only use a 
single thread for the operation

||branch||testall||dtest||
|[marcuse/11179|https://github.com/krummas/cassandra/tree/marcuse/11179]|[testall|http://cassci.datastax.com/view/Dev/view/krummas/job/krummas-marcuse-11179-testall]|[dtest|http://cassci.datastax.com/view/Dev/view/krummas/job/krummas-marcuse-11179-dtest]|
|[marcuse/11179-2.2|https://github.com/krummas/cassandra/tree/marcuse/11179-2.2]|[testall|http://cassci.datastax.com/view/Dev/view/krummas/job/krummas-marcuse-11179-2.2-testall]|[dtest|http://cassci.datastax.com/view/Dev/view/krummas/job/krummas-marcuse-11179-2.2-dtest]|
|[marcuse/11179-3.0|https://github.com/krummas/cassandra/tree/marcuse/11179-3.0]|[testall|http://cassci.datastax.com/view/Dev/view/krummas/job/krummas-marcuse-11179-3.0-testall]|[dtest|http://cassci.datastax.com/view/Dev/view/krummas/job/krummas-marcuse-11179-3.0-dtest]|
|[marcuse/11179-3.5|https://github.com/krummas/cassandra/tree/marcuse/11179-3.5]|[testall|http://cassci.datastax.com/view/Dev/view/krummas/job/krummas-marcuse-11179-3.5-testall]|[dtest|http://cassci.datastax.com/view/Dev/view/krummas/job/krummas-marcuse-11179-3.5-dtest]|
|[marcuse/11179-trunk|https://github.com/krummas/cassandra/tree/marcuse/11179-trunk]|[testall|http://cassci.datastax.com/view/Dev/view/krummas/job/krummas-marcuse-11179-trunk-testall]|[dtest|http://cassci.datastax.com/view/Dev/view/krummas/job/krummas-marcuse-11179-trunk-dtest]|

[~carlyeks] to review since we were poking this in CASSANDRA-10829

> Parallel cleanup can lead to disk space exhaustion
> --------------------------------------------------
>
>                 Key: CASSANDRA-11179
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-11179
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Compaction, Tools
>            Reporter: Tyler Hobbs
>            Assignee: Marcus Eriksson
>             Fix For: 2.1.x, 2.2.x, 3.0.x, 3.x
>
>
> In CASSANDRA-5547, we made cleanup (among other things) run in parallel 
> across multiple sstables.  There have been reports on IRC of this leading to 
> disk space exhaustion, because multiple sstables are (almost entirely) 
> rewritten at the same time.  This seems particularly problematic because 
> cleanup is frequently run after a cluster is expanded due to low disk space.
> I'm not really familiar with how we perform free disk space checks now, but 
> it sounds like we can make some improvements here.  It would be good to 
> reduce the concurrency of cleanup operations if there isn't enough free disk 
> space to support this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to