[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-21 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204917#comment-15204917 ] DOAN DuyHai commented on CASSANDRA-11383: - bq. we probably not going to remove SPARSE but

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-21 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204881#comment-15204881 ] Pavel Yaskevich commented on CASSANDRA-11383: - [~doanduyhai] We are currently working on

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-21 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15204144#comment-15204144 ] DOAN DuyHai commented on CASSANDRA-11383: - [~xedin] Ok last update from testing: - LCS

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-20 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203243#comment-15203243 ] DOAN DuyHai commented on CASSANDRA-11383: - bq. and numerical indexes are not required to be

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-20 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203226#comment-15203226 ] Pavel Yaskevich commented on CASSANDRA-11383: - [~doanduyhai] It looks like to me that

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-20 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203216#comment-15203216 ] Pavel Yaskevich commented on CASSANDRA-11383: - [~doanduyhai] Yes I think I will be able

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-20 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15203172#comment-15203172 ] DOAN DuyHai commented on CASSANDRA-11383: - [~xedin] Last update from the testing. I put the

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-20 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202223#comment-15202223 ] DOAN DuyHai commented on CASSANDRA-11383: - Ok 1. drop all indices 2. clean all *idx* files

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202094#comment-15202094 ] DOAN DuyHai commented on CASSANDRA-11383: - [~xedin] I dropped all the indices and recreated

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202084#comment-15202084 ] Pavel Yaskevich commented on CASSANDRA-11383: - Ok, so it's going to be 1G * 9 per

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread Jack Krupansky (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202141#comment-15202141 ] Jack Krupansky commented on CASSANDRA-11383: bq. recreated them one by one but with no

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread Jack Krupansky (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202080#comment-15202080 ] Jack Krupansky commented on CASSANDRA-11383: 1. How large are each of the text fields

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202951#comment-15202951 ] DOAN DuyHai commented on CASSANDRA-11383: - Ok it's clear now thanks for the clarification

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202042#comment-15202042 ] DOAN DuyHai commented on CASSANDRA-11383: - - memtable_heap_space_in_mb: 2048 -

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202934#comment-15202934 ] Pavel Yaskevich commented on CASSANDRA-11383: - [~doanduyhai] Let me first elaborate what

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202072#comment-15202072 ] DOAN DuyHai commented on CASSANDRA-11383: - If someone want the routine to generate the

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202134#comment-15202134 ] Pavel Yaskevich commented on CASSANDRA-11383: - Btw, how big is ma-1831-big-SI sstable

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202101#comment-15202101 ] DOAN DuyHai commented on CASSANDRA-11383: - By the way, I can use the hardware for the whole

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread Jack Krupansky (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202876#comment-15202876 ] Jack Krupansky commented on CASSANDRA-11383: The int field could easily be made a text

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread Jack Krupansky (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202877#comment-15202877 ] Jack Krupansky commented on CASSANDRA-11383: Sorry for any extra noise I may have

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202851#comment-15202851 ] DOAN DuyHai commented on CASSANDRA-11383: - [~jkrupan] Other than terminology and

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202156#comment-15202156 ] DOAN DuyHai commented on CASSANDRA-11383: - [~xedin] I can't promis anything but I'm going

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread Jack Krupansky (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202816#comment-15202816 ] Jack Krupansky commented on CASSANDRA-11383: The terminology is a bit confusing here -

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202088#comment-15202088 ] DOAN DuyHai commented on CASSANDRA-11383: - [~jkrupan] 1. Not that large, see below the

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202027#comment-15202027 ] Pavel Yaskevich commented on CASSANDRA-11383: - What is your memtable size? all of the

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202162#comment-15202162 ] DOAN DuyHai commented on CASSANDRA-11383: - [~jkrupan] "I mean, can even one index alone

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202117#comment-15202117 ] Pavel Yaskevich commented on CASSANDRA-11383: - It would be very helpful if you could

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202712#comment-15202712 ] DOAN DuyHai commented on CASSANDRA-11383: - bq. I've figured out what is going on and first of

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread Jack Krupansky (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202196#comment-15202196 ] Jack Krupansky commented on CASSANDRA-11383: Just to make sure I understand what's going

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202669#comment-15202669 ] Pavel Yaskevich commented on CASSANDRA-11383: - [~doanduyhai] I've figured out what is

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202206#comment-15202206 ] DOAN DuyHai commented on CASSANDRA-11383: - [~jkrupan] 1. --> Yes correct 2. Originally we

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-19 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202575#comment-15202575 ] Pavel Yaskevich commented on CASSANDRA-11383: - [~doanduyhai] I've successfully downloaded

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-18 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202259#comment-15202259 ] DOAN DuyHai commented on CASSANDRA-11383: - [~xedin] OK, I'm trying to fetch the sstable

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-18 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202281#comment-15202281 ] Pavel Yaskevich commented on CASSANDRA-11383: - [~doanduyhai] Ok yeah, it looks like there

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-18 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202377#comment-15202377 ] Pavel Yaskevich commented on CASSANDRA-11383: - [~doanduyhai] Thanks! I've already started

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-18 Thread Jack Krupansky (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202241#comment-15202241 ] Jack Krupansky commented on CASSANDRA-11383: What's the table schema? Is

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-18 Thread Pavel Yaskevich (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202245#comment-15202245 ] Pavel Yaskevich commented on CASSANDRA-11383: - [~doanduyhai] So it actually happens when

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-18 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202353#comment-15202353 ] DOAN DuyHai commented on CASSANDRA-11383: - [~xedin] Upload is on the way, here is the

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-18 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202262#comment-15202262 ] DOAN DuyHai commented on CASSANDRA-11383: - [~jkrupan] Below is the schema: {code:sql}

[jira] [Commented] (CASSANDRA-11383) SASI index build leads to massive OOM

2016-03-18 Thread DOAN DuyHai (JIRA)
[ https://issues.apache.org/jira/browse/CASSANDRA-11383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202070#comment-15202070 ] DOAN DuyHai commented on CASSANDRA-11383: - I try to create indices ONE by ONE, but same