Re: Tune cache MB settings per table.

2014-06-02 Thread Robert Coli
On Sun, Jun 1, 2014 at 12:49 PM, Kevin Burton bur...@spinn3r.com wrote: It's possible to set caching to: all, keys_only, rows_only, or none .. for a given table. But we have one table which is MASSIVE and we only need the most recent 4-8 hours in memory. Anything older than that can go

Tune cache MB settings per table.

2014-06-01 Thread Kevin Burton
It's possible to set caching to: all, keys_only, rows_only, or none .. for a given table. But we have one table which is MASSIVE and we only need the most recent 4-8 hours in memory. Anything older than that can go to disk as the queries there are very rare. … but I don't think cassandra can

Re: Tune cache MB settings per table.

2014-06-01 Thread Colin
The OS should handle this really well as long as your on v3 linux kernel -- Colin Clark +1-320-221-9531 On Jun 1, 2014, at 2:49 PM, Kevin Burton bur...@spinn3r.com wrote: It's possible to set caching to: all, keys_only, rows_only, or none .. for a given table. But we have

Re: Tune cache MB settings per table.

2014-06-01 Thread DuyHai Doan
Hello Kevin You'll be probably interested by this : http://www.datastax.com/dev/blog/row-caching-in-cassandra-2-1 On Sun, Jun 1, 2014 at 9:49 PM, Kevin Burton bur...@spinn3r.com wrote: It's possible to set caching to: all, keys_only, rows_only, or none .. for a given table. But we have

Re: Tune cache MB settings per table.

2014-06-01 Thread Kevin Burton
Not in our experience… We've been using fadvise don't need to purge pages that aren't necessary any longer. Of course YMMV based on your usage. I tend to like to control everything explicitly instead of having magic. That's worked out very well for us in the past so it would be nice to still

Re: Tune cache MB settings per table.

2014-06-01 Thread Colin
Have you been unable to achieve your SLA's using Cassandra out of the box so far? Based upon my experience, trying to tune Cassandra before the app is done and without simulating real world load patterns, you might actually be doing yourself a disservice. -- Colin 320-221-9531 On Jun 1,

Re: Tune cache MB settings per table.

2014-06-01 Thread Jonathan Haddad
I think of all the areas you could spend your time, this will have the least returns. The OS will keep the most frequently used data in memory. There's no reason to require cassandra to do it. If you're curious as to what's been loaded into ram, try Al Tobey's pcstat utility.

Re: Tune cache MB settings per table.

2014-06-01 Thread Kevin Burton
Good question. still migrating.. but we don't want to paint ourselves into a corner. There's an interesting line between premature optimization and painting yourself into a corner ;) Best to get it right in between both extremes. On Sun, Jun 1, 2014 at 4:30 PM, Colin colpcl...@gmail.com wrote:

Re: Tune cache MB settings per table.

2014-06-01 Thread Colin
Your data model will most likely be the far most important component of your migration. Get that right, and the rest is easy. -- Colin Clark +1-320-221-9531 On Jun 1, 2014, at 7:01 PM, Kevin Burton bur...@spinn3r.com wrote: Good question. still migrating.. but we don't want to paint