Re: How many BATCH inserts in to many?

2013-01-16 Thread Alan Ristić
many BATCH inserts in to many? With regard to a large number of records in a batch mutation there are some potential issues. Each row becomes a task in the write thread pool on each replica. If a single client sends 1,000 rows in a mutation it will take time for the (default) 32 threads

Re: How many BATCH inserts in to many?

2013-01-14 Thread Vitalii Tymchyshyn
Sent: Sunday, January 13, 2013 7:57:56 PM Subject: Re: How many BATCH inserts in to many? With regard to a large number of records in a batch mutation there are some potential issues. Each row becomes a task in the write thread pool on each replica. If a single client sends 1,000 rows

Re: How many BATCH inserts in to many?

2013-01-13 Thread Radim Kolar
do not use cassandra for implementing queueing system with high throughput. It does not scale because of tombstone management. Use hornetQ, its amazingly fast broker but it has quite slow persistence if you want to create queues significantly larger then your memory and use selectors for

Re: How many BATCH inserts in to many?

2013-01-13 Thread aaron morton
With regard to a large number of records in a batch mutation there are some potential issues. Each row becomes a task in the write thread pool on each replica. If a single client sends 1,000 rows in a mutation it will take time for the (default) 32 threads in the write pool to work through

Re: How many BATCH inserts in to many?

2013-01-13 Thread Wei Zhu
@cassandra.apache.org Sent: Sunday, January 13, 2013 7:57:56 PM Subject: Re: How many BATCH inserts in to many? With regard to a large number of records in a batch mutation there are some potential issues. Each row becomes a task in the write thread pool on each replica. If a single client sends 1,000 rows

Re: How many BATCH inserts in to many?

2013-01-12 Thread Carlos Rolo
Hello, I have managed to insert up to 63k records without any problem. In certain workloads I found that massive batch inserts perform way better than lots of not-so-massive inserts. I guess it also depends on your setup. Just try it. Alan Ristić alan.ris...@gmail.com escreveu: Hi, I'm

Re: How many BATCH inserts in to many?

2013-01-12 Thread Alan Ristić
wauu! huh...em...wau - can't say anything else. Tnx for insight, it certanly gives me some frame how batch is performing. Tnx a lot. 2013/1/12 Carlos Rolo c.r...@ocom.com 63k rec Lp, *Alan Ristić* *m*: 040 423 688

How many BATCH inserts in to many?

2013-01-11 Thread Alan Ristić
Hi, I'm implementing Facebook style notifications/activities (e.g your friend liked this article) in our app. I considered message queue for this task before exploring how BATCH insert in C* could perform. Could I leave Queue altogether and just use batch insert? Is like...5000 insers too much