Re: Size Tiered - Leveled Compaction

2013-03-26 Thread Alain RODRIGUEZ
Zhu wz1...@yahoo.commailto:wz1...@yahoo.com Date: Friday, March 8, 2013 11:11 AM To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Subject: Re: Size Tiered - Leveled Compaction I have the same wonder. We started

Re: Size Tiered - Leveled Compaction

2013-03-08 Thread Alain RODRIGUEZ
: Size Tiered - Leveled Compaction I second these questions: we've been looking into changing some of our CFs to use leveled compaction as well. If anybody here has the wisdom to answer them it would be of wonderful help. Thanks Charles On Wed, Feb 13, 2013 at 7:50 AM, Mike mthero

Re: Size Tiered - Leveled Compaction

2013-03-08 Thread Wei Zhu
From: Alain RODRIGUEZ arodr...@gmail.com To: user@cassandra.apache.org Cc: Wei Zhu wz1...@yahoo.com Sent: Friday, March 8, 2013 1:25 AM Subject: Re: Size Tiered - Leveled Compaction I'm still wondering about how to chose the size of the sstable under LCS. Defaul is 5MB

Re: Size Tiered - Leveled Compaction

2013-03-08 Thread Hiller, Dean
, 2013 11:11 AM To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Subject: Re: Size Tiered - Leveled Compaction I have the same wonder. We started with the default 5M and the compaction after repair takes too long on 200G node

Re: Size Tiered - Leveled Compaction

2013-03-08 Thread Michael Theroux
Subject: Re: Size Tiered - Leveled Compaction I have the same wonder. We started with the default 5M and the compaction after repair takes too long on 200G node, so we increase the size to 10M sort of arbitrarily since there is not much documentation around it. Our tech op team still thinks

Re: Size Tiered - Leveled Compaction

2013-03-07 Thread Al Tobey
, I'm investigating the transition of some of our column families from Size Tiered - Leveled Compaction. I believe we have some high-read-load column families that would benefit tremendously. I've stood up a test DB Node to investigate the transition. I successfully alter the column family, and I

Re: Size Tiered - Leveled Compaction

2013-02-25 Thread Alain RODRIGUEZ
from Size Tiered-Leveled compaction this weekend. I was doing some research around some of the bugs that were filed against leveled compaction in Cassandra and I found this: https://issues.apache.org/jira/browse/CASSANDRA-4644 The bug mentions: You need to run the offline scrub (bin

Re: Size Tiered - Leveled Compaction

2013-02-25 Thread Alain RODRIGUEZ
, 2013 7:15 AM To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Subject: Re: Size Tiered - Leveled Compaction I am confused. I thought running compact turns off the minor compactions and users are actually supposed to run

Re: Size Tiered - Leveled Compaction

2013-02-25 Thread Hiller, Dean
@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Subject: Re: Size Tiered - Leveled Compaction After running a major compaction, automatic minor compactions are no longer triggered, ... Because of the size difference between the big sstable generated

Re: Size Tiered - Leveled Compaction

2013-02-24 Thread aaron morton
, February 17, 2013 4:50:40 AM Subject: Re: Size Tiered - Leveled Compaction Hello Wei, First thanks for this response. Out of curiosity, what SSTable size did you choose for your usecase, and what made you decide on that number? Thanks, -Mike On 2/14/2013 3:51 PM, Wei Zhu wrote

Re: Size Tiered - Leveled Compaction

2013-02-22 Thread Mike
Hello, Still doing research before we potentially move one of our column families from Size Tiered-Leveled compaction this weekend. I was doing some research around some of the bugs that were filed against leveled compaction in Cassandra and I found this: https://issues.apache.org/jira

Re: Size Tiered - Leveled Compaction

2013-02-17 Thread Mike
*From:* Charles Brophy cbro...@zulily.com *To:* user@cassandra.apache.org *Sent:* Thursday, February 14, 2013 8:29 AM *Subject:* Re: Size Tiered - Leveled Compaction I second these questions: we've been looking into changing some of our CFs to use leveled

Re: Size Tiered - Leveled Compaction

2013-02-17 Thread Wei Zhu
. - Original Message - From: Mike mthero...@yahoo.com To: user@cassandra.apache.org Sent: Sunday, February 17, 2013 4:50:40 AM Subject: Re: Size Tiered - Leveled Compaction Hello Wei, First thanks for this response. Out of curiosity, what SSTable size did you choose for your usecase

Re: Size Tiered - Leveled Compaction

2013-02-16 Thread Mike
@cassandra.apache.org *Sent:* Thursday, February 14, 2013 8:29 AM *Subject:* Re: Size Tiered - Leveled Compaction I second these questions: we've been looking into changing some of our CFs to use leveled compaction as well. If anybody here has the wisdom to answer them it would be of wonderful help. Thanks

Re: Size Tiered - Leveled Compaction

2013-02-14 Thread Charles Brophy
the transition of some of our column families from Size Tiered - Leveled Compaction. I believe we have some high-read-load column families that would benefit tremendously. I've stood up a test DB Node to investigate the transition. I successfully alter the column family, and I immediately

Re: Size Tiered - Leveled Compaction

2013-02-14 Thread Wei Zhu
the SSTable distribution among different levels.  -Wei From: Charles Brophy cbro...@zulily.com To: user@cassandra.apache.org Sent: Thursday, February 14, 2013 8:29 AM Subject: Re: Size Tiered - Leveled Compaction I second these questions: we've been looking

Re: Size Tiered - Leveled Compaction

2013-02-14 Thread Michael Theroux
directory and it tells you the SSTable distribution among different levels. -Wei From: Charles Brophy cbro...@zulily.com To: user@cassandra.apache.org Sent: Thursday, February 14, 2013 8:29 AM Subject: Re: Size Tiered - Leveled Compaction I second these questions: we've been looking

Size Tiered - Leveled Compaction

2013-02-13 Thread Mike
Hello, I'm investigating the transition of some of our column families from Size Tiered - Leveled Compaction. I believe we have some high-read-load column families that would benefit tremendously. I've stood up a test DB Node to investigate the transition. I successfully alter the column