Re: Manual Compaction in Production

2010-11-08 Thread Jonathan Ellis
On Mon, Nov 8, 2010 at 8:23 PM, Edward Capriolo wrote: > I am using a build with support for removing tombstones during minor > compacts. I am pretty happy to see SSTables shrink during non-major > compactions. If I understand correctly bloomfilters have false > positives, so a key may appear to b

Re: Manual Compaction in Production

2010-11-08 Thread Edward Capriolo
On Mon, Nov 8, 2010 at 6:16 PM, Jonathan Ellis wrote: > After Sylvain added support for removing tombstones during minor > compactions in 0.6.6 (see > http://www.riptano.com/blog/whats-new-cassandra-066), doing major > compactions should be considered unnecessary until otherwise > demonstrated for

Re: Manual Compaction in Production

2010-11-08 Thread Jonathan Ellis
After Sylvain added support for removing tombstones during minor compactions in 0.6.6 (see http://www.riptano.com/blog/whats-new-cassandra-066), doing major compactions should be considered unnecessary until otherwise demonstrated for your workload. (If you happen to have weekly slow periods into

Re: Manual Compaction in Production

2010-11-08 Thread Edward Capriolo
On Mon, Nov 8, 2010 at 5:07 PM, Wayne wrote: > Can anyone speak to best practices for running manual compaction in > production? Our assumption is that without it the sstables will become too > fragmented...is this an accepted "fact"? Obviously it depends on the volume > of writes, but I am lookin