[jira] [Commented] (CASSANDRA-10084) Very slow performance streaming a large query from a single CF

[ https://issues.apache.org/jira/browse/CASSANDRA-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14705971#comment-14705971 ] Brent Haines commented on CASSANDRA-10084: -- I did a lot of tuning with

[jira] [Comment Edited] (CASSANDRA-10084) Very slow performance streaming a large query from a single CF

[ https://issues.apache.org/jira/browse/CASSANDRA-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14705971#comment-14705971 ] Brent Haines edited comment on CASSANDRA-10084 at 8/21/15 12:47 AM:

[jira] [Comment Edited] (CASSANDRA-10084) Very slow performance streaming a large query from a single CF

[ https://issues.apache.org/jira/browse/CASSANDRA-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14705971#comment-14705971 ] Brent Haines edited comment on CASSANDRA-10084 at 8/21/15 12:42 AM:

[jira] [Updated] (CASSANDRA-10084) Very slow performance streaming a large query from a single CF

[ https://issues.apache.org/jira/browse/CASSANDRA-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brent Haines updated CASSANDRA-10084: - Attachment: node3.txt node2.txt node1.txt stack

[jira] [Comment Edited] (CASSANDRA-10084) Very slow performance streaming a large query from a single CF

[ https://issues.apache.org/jira/browse/CASSANDRA-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14705974#comment-14705974 ] Brent Haines edited comment on CASSANDRA-10084 at 8/20/15 11:41 PM:

[jira] [Commented] (CASSANDRA-10084) Very slow performance streaming a large query from a single CF

[ https://issues.apache.org/jira/browse/CASSANDRA-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699680#comment-14699680 ] Brent Haines commented on CASSANDRA-10084: -- FWIW, changing to LCS helped

[jira] [Commented] (CASSANDRA-10084) Very slow performance streaming a large query from a single CF

[ https://issues.apache.org/jira/browse/CASSANDRA-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699716#comment-14699716 ] Brent Haines commented on CASSANDRA-10084: -- Ah. I was afraid of that. We'd

[jira] [Created] (CASSANDRA-10084) Very slow performance streaming a large query from a single CF

Brent Haines created CASSANDRA-10084: Summary: Very slow performance streaming a large query from a single CF Key: CASSANDRA-10084 URL: https://issues.apache.org/jira/browse/CASSANDRA-10084

[jira] [Commented] (CASSANDRA-9486) LazilyCompactedRow accumulates all expired RangeTombstones

[ https://issues.apache.org/jira/browse/CASSANDRA-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569721#comment-14569721 ] Brent Haines commented on CASSANDRA-9486: - FWIW -- I created a patch from

[jira] [Commented] (CASSANDRA-8723) Cassandra 2.1.2 Memory issue - java process memory usage continuously increases until process is killed by OOM killer

[ https://issues.apache.org/jira/browse/CASSANDRA-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531583#comment-14531583 ] Brent Haines commented on CASSANDRA-8723: - So I generated a binary dump and

[jira] [Commented] (CASSANDRA-8723) Cassandra 2.1.2 Memory issue - java process memory usage continuously increases until process is killed by OOM killer

[ https://issues.apache.org/jira/browse/CASSANDRA-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531336#comment-14531336 ] Brent Haines commented on CASSANDRA-8723: - Generating the dump now. While that

[jira] [Comment Edited] (CASSANDRA-8723) Cassandra 2.1.2 Memory issue - java process memory usage continuously increases until process is killed by OOM killer

[ https://issues.apache.org/jira/browse/CASSANDRA-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531336#comment-14531336 ] Brent Haines edited comment on CASSANDRA-8723 at 5/6/15 8:25 PM:

[jira] [Commented] (CASSANDRA-8723) Cassandra 2.1.2 Memory issue - java process memory usage continuously increases until process is killed by OOM killer

[ https://issues.apache.org/jira/browse/CASSANDRA-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531230#comment-14531230 ] Brent Haines commented on CASSANDRA-8723: - I upgraded to 2.1.5 and the two

[jira] [Commented] (CASSANDRA-8723) Cassandra 2.1.2 Memory issue - java process memory usage continuously increases until process is killed by OOM killer

[ https://issues.apache.org/jira/browse/CASSANDRA-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14530925#comment-14530925 ] Brent Haines commented on CASSANDRA-8723: - FWIW - we still experience a

[jira] [Commented] (CASSANDRA-9033) Upgrading from 2.1.1 to 2.1.3 with LCS and many sstable files makes nodes unresponsive

[ https://issues.apache.org/jira/browse/CASSANDRA-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382150#comment-14382150 ] Brent Haines commented on CASSANDRA-9033: - Holy shit. You're right. I

[jira] [Commented] (CASSANDRA-9033) Upgrading from 2.1.1 to 2.1.3 with LCS and many sstable files makes nodes unresponsive

[ https://issues.apache.org/jira/browse/CASSANDRA-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382416#comment-14382416 ] Brent Haines commented on CASSANDRA-9033: - I did not maintain logs for the

[jira] [Commented] (CASSANDRA-9033) Upgrading from 2.1.1 to 2.1.3 with LCS and many sstable files makes nodes unresponsive

[ https://issues.apache.org/jira/browse/CASSANDRA-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14382084#comment-14382084 ] Brent Haines commented on CASSANDRA-9033: - If we run 2.1.3 our cluster *will*

[jira] [Created] (CASSANDRA-9033) Upgrading from 2.1.1 to 2.1.3 with LCS and many sstable files makes nodes unresponsive

Brent Haines created CASSANDRA-9033: --- Summary: Upgrading from 2.1.1 to 2.1.3 with LCS and many sstable files makes nodes unresponsive Key: CASSANDRA-9033 URL:

[jira] [Comment Edited] (CASSANDRA-8723) Cassandra 2.1.2 Memory issue - java process memory usage continuously increases until process is killed by OOM killer

[ https://issues.apache.org/jira/browse/CASSANDRA-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311864#comment-14311864 ] Brent Haines edited comment on CASSANDRA-8723 at 2/9/15 6:47 AM:

[jira] [Comment Edited] (CASSANDRA-8723) Cassandra 2.1.2 Memory issue - java process memory usage continuously increases until process is killed by OOM killer

[ https://issues.apache.org/jira/browse/CASSANDRA-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311864#comment-14311864 ] Brent Haines edited comment on CASSANDRA-8723 at 2/9/15 6:55 AM:

[jira] [Commented] (CASSANDRA-8723) Cassandra 2.1.2 Memory issue - java process memory usage continuously increases until process is killed by OOM killer

[ https://issues.apache.org/jira/browse/CASSANDRA-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14311864#comment-14311864 ] Brent Haines commented on CASSANDRA-8723: - I ran { watch -n 10 'nodetool

[jira] [Commented] (CASSANDRA-8723) Cassandra 2.1.2 Memory issue - java process memory usage continuously increases until process is killed by OOM killer

[ https://issues.apache.org/jira/browse/CASSANDRA-8723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14310883#comment-14310883 ] Brent Haines commented on CASSANDRA-8723: - We were able to work around a

[jira] [Commented] (CASSANDRA-8552) Large compactions run out of off-heap RAM

[ https://issues.apache.org/jira/browse/CASSANDRA-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14284650#comment-14284650 ] Brent Haines commented on CASSANDRA-8552: - Thanks. I am running several

[jira] [Updated] (CASSANDRA-8552) Large compactions run out of off-heap RAM

[ https://issues.apache.org/jira/browse/CASSANDRA-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brent Haines updated CASSANDRA-8552: Attachment: data.cql Here is our schema for application data Large compactions run

[jira] [Commented] (CASSANDRA-8552) Large compactions run out of off-heap RAM

[ https://issues.apache.org/jira/browse/CASSANDRA-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14270185#comment-14270185 ] Brent Haines commented on CASSANDRA-8552: - The stories* tables are, but that

[jira] [Commented] (CASSANDRA-8552) Large compactions run out of off-heap RAM

[ https://issues.apache.org/jira/browse/CASSANDRA-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14267860#comment-14267860 ] Brent Haines commented on CASSANDRA-8552: - The repair took a long time (first

[jira] [Commented] (CASSANDRA-8552) Large compactions run out of off-heap RAM

[ https://issues.apache.org/jira/browse/CASSANDRA-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14266643#comment-14266643 ] Brent Haines commented on CASSANDRA-8552: - Quick update - the node was cleared

[jira] [Commented] (CASSANDRA-8552) Large compactions run out of off-heap RAM

[ https://issues.apache.org/jira/browse/CASSANDRA-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14265400#comment-14265400 ] Brent Haines commented on CASSANDRA-8552: - We have 4 tables in the keyspace -

[jira] [Updated] (CASSANDRA-8552) Large compactions run out of off-heap RAM

[ https://issues.apache.org/jira/browse/CASSANDRA-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brent Haines updated CASSANDRA-8552: Attachment: freelog.log Following your initial take, I decided to execute [watch -d

[jira] [Updated] (CASSANDRA-8552) Large compactions run out of off-heap RAM

[ https://issues.apache.org/jira/browse/CASSANDRA-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brent Haines updated CASSANDRA-8552: Attachment: fhandles.log Damn. That was a promising theory (at least I think so). I

[jira] [Updated] (CASSANDRA-8552) Large compactions run out of off-heap RAM

[ https://issues.apache.org/jira/browse/CASSANDRA-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brent Haines updated CASSANDRA-8552: Attachment: sysctl.txt meminfo.txt lsof.txt Just added

[jira] [Commented] (CASSANDRA-8552) Large compactions run out of off-heap RAM

[ https://issues.apache.org/jira/browse/CASSANDRA-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263426#comment-14263426 ] Brent Haines commented on CASSANDRA-8552: - I am not sure how to compact each

[jira] [Updated] (CASSANDRA-8552) Large compactions run out of off-heap RAM

[ https://issues.apache.org/jira/browse/CASSANDRA-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brent Haines updated CASSANDRA-8552: Reproduced In: 2.1.2, 2.1.1 (was: 2.1.1, 2.1.2) Environment: Ubuntu 14.4 AWS

[jira] [Updated] (CASSANDRA-8552) Large compactions run out of off-heap RAM

[ https://issues.apache.org/jira/browse/CASSANDRA-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brent Haines updated CASSANDRA-8552: Attachment: Screen Shot 2015-01-02 at 9.36.11 PM.png This is how the system looks after

[jira] [Commented] (CASSANDRA-8552) Large compactions run out of off-heap RAM

[ https://issues.apache.org/jira/browse/CASSANDRA-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263428#comment-14263428 ] Brent Haines commented on CASSANDRA-8552: - Here is the syslog after upgrading

[jira] [Comment Edited] (CASSANDRA-8552) Large compactions run out of off-heap RAM

[ https://issues.apache.org/jira/browse/CASSANDRA-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263428#comment-14263428 ] Brent Haines edited comment on CASSANDRA-8552 at 1/3/15 5:45 AM:

[jira] [Created] (CASSANDRA-8552) Large compactions run out of off-heap RAM

Brent Haines created CASSANDRA-8552: --- Summary: Large compactions run out of off-heap RAM Key: CASSANDRA-8552 URL: https://issues.apache.org/jira/browse/CASSANDRA-8552 Project: Cassandra

[jira] [Created] (CASSANDRA-6687) CQL: drop table if exists throws exception when table does not exist

Brent Haines created CASSANDRA-6687: --- Summary: CQL: drop table if exists throws exception when table does not exist Key: CASSANDRA-6687 URL: https://issues.apache.org/jira/browse/CASSANDRA-6687