Re: 4k keyspaces... Maybe we're doing it wrong?

2010-09-11 Thread samal gorai
Lot of memtables means lot of sstables means lot of disk io. On 9/7/10, Benjamin Black b...@b3k.us wrote: On Mon, Sep 6, 2010 at 12:41 AM, Janne Jalkanen janne.jalka...@ecyrd.com wrote: So if I read this right, using lots of CF's is also a Bad Idea(tm)? Yes, lots of CFs is bad means lots

Re: 4k keyspaces... Maybe we're doing it wrong?

2010-09-06 Thread Benjamin Black
On Mon, Sep 6, 2010 at 12:41 AM, Janne Jalkanen janne.jalka...@ecyrd.com wrote: So if I read this right, using lots of CF's is also a Bad Idea(tm)? Yes, lots of CFs is bad means lots of CFs is also bad.

Re: 4k keyspaces... Maybe we're doing it wrong?

2010-09-04 Thread Aaron Morton
Yes, right now it's probably not technically possible, from a resource point of view, to run 4k keyspaces in a cassandra cluster. Those management features you may have been able to do as meta data operations will prob become long running background tasks. Aaron On 3 Sep 2010, at 21:28, Mike

Re: 4k keyspaces... Maybe we're doing it wrong?

2010-09-03 Thread Mike Peters
Very interesting. Thank you So it sounds like other than being able to quickly truncate customer-keyspaces, with Cassandra there's no real benefit in keeping each customer data in a separate keyspace. We'll suffer on the memory side with all the switching between keyspaces and we're better

Re: 4k keyspaces... Maybe we're doing it wrong?

2010-09-03 Thread vineet daniel
If I am correct than you need to restart cassandra whenever you adding a new KeySpace. Thats another concern. Vineet Daniel Cell : +91-8106217121 Websites : Blog http://vinetedaniel.blogspot.com | Linkedinhttp://in.linkedin.com/in/vineetdaniel | Twitter

Re: 4k keyspaces... Maybe we're doing it wrong?

2010-09-03 Thread Mike Peters
We're using 0.7 On 9/3/2010 6:48 AM, vineet daniel wrote: If I am correct than you need to restart cassandra whenever you adding a new KeySpace. Thats another concern. Vineet Daniel Cell : +91-8106217121 Websites : Blog http://vinetedaniel.blogspot.com | Linkedin

4k keyspaces... Maybe we're doing it wrong?

2010-09-02 Thread Mike Peters
Hi, We're in the process of migrating 4,000 MySQL client databases to Cassandra. All database schemas are identical. With MySQL, we used to provision a separate 'database' per each client, to make it easier to shard and move things around. Does it make sense to migrate the 4,000 MySQL

Re: 4k keyspaces... Maybe we're doing it wrong?

2010-09-02 Thread Aaron Morton
Create one big happy love in keyspace. Use the key structure to identify the different clients data.The is more support for multi tenancy systems but a lot of the memory configuration is per keyspace/column family, so you cannot run that many keyspaces.This page has some more