Re: Write performance expectations...

2013-02-14 Thread kadey
, February 13, 2013 11:06:30 AM Subject: Re: Write performance expectations... 2500 inserts per second is about what a single python thread using pycassa can do against a local node. Are you using multiple threads for the inserts? Multiple processes? On Wed, Feb 13, 2013 at 8:21 AM, Alain

Re: Write performance expectations...

2013-02-14 Thread Peter Lin
: Wednesday, February 13, 2013 11:06:30 AM Subject: Re: Write performance expectations... 2500 inserts per second is about what a single python thread using pycassa can do against a local node. Are you using multiple threads for the inserts? Multiple processes? On Wed, Feb 13, 2013 at 8:21 AM, Alain

Re: Write performance expectations...

2013-02-14 Thread kadey
that an instance goes down for whatever reason? Ken - Original Message - From: Alain RODRIGUEZ arodr...@gmail.com To: user@cassandra.apache.org Sent: Thursday, February 14, 2013 8:34:06 AM Subject: Re: Write performance expectations... Hi Ken, You really should take a look

Re: Write performance expectations...

2013-02-14 Thread Alain RODRIGUEZ
*Subject: *Re: Write performance expectations... Hi Ken, You really should take a look at my first answer... and give us more information on the size of your inserts, the type of EC2 you are using at least. You should also consider using Instance store and not EBS. Well, look at all these things

Write performance expectations...

2013-02-13 Thread kadey
Hello, New member here, and I have (yet another) question on write performance. I'm using Apache Cassandra version 1.1, Python 2.7 and Pycassa 1.7. I have a cluster of 2 datacenters, each with 3 nodes, on AWS EC2 using EBS and the RandomPartioner. I'm writing to a column family in a keyspace

Re: Write performance expectations...

2013-02-13 Thread Alain RODRIGUEZ
Is there a particular reason for you to use EBS ? Instance Store are recommended because they improve performances by reducing the I/O throttling. An other thing you should be aware of is that replicating the data to all node reduce your performance, it is more or less like if you had only one

Re: Write performance expectations...

2013-02-13 Thread Tyler Hobbs
2500 inserts per second is about what a single python thread using pycassa can do against a local node. Are you using multiple threads for the inserts? Multiple processes? On Wed, Feb 13, 2013 at 8:21 AM, Alain RODRIGUEZ arodr...@gmail.com wrote: Is there a particular reason for you to use

Re: Write performance expectations...

2013-02-13 Thread kadey
I'm not using multi-threads/processes. I'll try multi-threading to see if I get a boost. Thanks. Ken - Original Message - From: Tyler Hobbs ty...@datastax.com To: user@cassandra.apache.org Sent: Wednesday, February 13, 2013 11:06:30 AM Subject: Re: Write performance

Re: Write performance expectations...

2013-02-13 Thread Ken Adey
: *Tyler Hobbs ty...@datastax.com mailto:ty...@datastax.com *To: *user@cassandra.apache.org mailto:user@cassandra.apache.org *Sent: *Wednesday, February 13, 2013 11:06:30 AM *Subject: *Re: Write performance expectations... 2500 inserts per second is about what a single python thread