RE: hardware sizing for cassandra

2014-09-09 Thread Arindam Barua
From my experience, and what I've read, more the RAM the better. Any excess memory can be used as disk cache, which should help with your reads a lot. -Arindam -Original Message- From: Paolo Crosato [mailto:paolo.cros...@targaubiest.com] Sent: Tuesday, September 09, 2014 12:53 PM To:

RE: Some questions to adding a new datacenter into cassandra cluster.

2014-04-30 Thread Arindam Barua
Answers inline. From: Lu, Boying [mailto:boying...@emc.com] Sent: Wednesday, April 30, 2014 12:20 AM To: user@cassandra.apache.org Subject: Some questions to adding a new datacenter into cassandra cluster. Hi, All, I need to add a Cassandra (running on a three nodes) fresh installed in a

RE: Can Cassandra work efficiently with multiple data directories on multiple disks?

2014-04-30 Thread Arindam Barua
This thread should answer your questions: http://stackoverflow.com/questions/15925549/how-cassandra-split-keyspace-data-when-multiple-dirctories-found From: Yatong Zhang [mailto:bluefl...@gmail.com] Sent: Wednesday, April 30, 2014 2:03 AM To: user@cassandra.apache.org Subject: Can Cassandra

RE: Can the seeds list be changed at runtime?

2014-04-30 Thread Arindam Barua
For new nodes that you want to bootstrap into the cluster you can specify any nodes you wish. Note that you want to keep your seed list consistent across your cluster though. From: Mark Reddy [mailto:mark.re...@boxever.com] Sent: Tuesday, April 29, 2014 2:26 AM To: user@cassandra.apache.org

RE: Migrating Cassandra to New Nodes

2014-04-29 Thread Arindam Barua
What you have described below should work just fine. When I was replacing nodes in my ring, I ended up creating a new datacenter with the new nodes, but I was upgrading to vnodes too at the time. -Arindam From: nash [mailto:nas...@gmail.com] Sent: Monday, April 28, 2014 10:52 PM To:

RE: java.lang.OutOfMemoryError: Java heap space

2014-04-28 Thread Arindam Barua
If you don’t have row caching turned on, you can try changing settings to get your memtables to flush faster (read more at the datastax documention at [1]). Btw, if you are using a pre-1.2 version, your bloom filter might come into play as well. All said and done, if your write request rate

RE: Supported Cassandra version for CentOS 5.5

2014-02-26 Thread Arindam Barua
I am running Cassandra 1.2.12 on CentOS 5.10. Was running 1.1.15 previously without any issues as well. -Arindam From: Donald Smith [mailto:donald.sm...@audiencescience.com] Sent: Tuesday, February 25, 2014 3:40 PM To: user@cassandra.apache.org Subject: RE: Supported Cassandra version for

RE: Bootstrap stuck: vnode enabled 1.2.12

2014-02-26 Thread Arindam Barua
As an update - finally got the node to join the ring. Restarting all the nodes in the cluster, followed by a clean bootstrap of the node that was stuck did the trick. -Arindam From: Arindam Barua [mailto:aba...@247-inc.com] Sent: Monday, February 24, 2014 5:04 PM To: user@cassandra.apache.org

RE: Bootstrap stuck: vnode enabled 1.2.12

2014-02-24 Thread Arindam Barua
) Streaming from /10.67.XXX.XXX failed From: Arindam Barua [mailto:aba...@247-inc.com] Sent: Tuesday, February 18, 2014 5:16 PM To: user@cassandra.apache.org Subject: RE: Bootstrap stuck: vnode enabled 1.2.12 I believe you are talking about CASSANDRA-6685, which was introduced in 1.2.15. I'm trying

RE: Bootstrap stuck: vnode enabled 1.2.12

2014-02-18 Thread Arindam Barua
The node is still out of the ring. Any suggestions on how to get it in will be very helpful. From: Arindam Barua [mailto:aba...@247-inc.com] Sent: Friday, February 14, 2014 1:04 AM To: user@cassandra.apache.org Subject: Bootstrap stuck: vnode enabled 1.2.12 After our otherwise successful

RE: Bootstrap stuck: vnode enabled 1.2.12

2014-02-18 Thread Arindam Barua
Subject: Re: Bootstrap stuck: vnode enabled 1.2.12 There is a bug where a node without schema can not bootstrap. Do you have schema? On Tue, Feb 18, 2014 at 1:29 PM, Arindam Barua aba...@247-inc.commailto:aba...@247-inc.com wrote: The node is still out of the ring. Any suggestions on how to get

Bootstrap stuck: vnode enabled 1.2.12

2014-02-14 Thread Arindam Barua
After our otherwise successful upgrade procedure to enable vnodes, when adding back new hosts to our cluster, one non-seed host ran into a hardware issue during bootstrap. By the time the hardware issue was fixed a week later, all other nodes were added successfully, cleaned, repaired. The

RE: vnode in production

2014-01-06 Thread Arindam Barua
subsequently. -Original Message- From: Chris Burroughs [mailto:chris.burrou...@gmail.com] Sent: Monday, January 06, 2014 10:00 AM To: user@cassandra.apache.org Subject: Re: vnode in production On 01/02/2014 01:51 PM, Arindam Barua wrote: 1. the stability of vnodes in production I'm

vnode in production

2014-01-02 Thread Arindam Barua
Hello all, Just wanted to check if anyone has any experiences to share regarding 1. the stability of vnodes in production 2. upgrading to vnodes in production We recently upgraded to 1.2.12 in production and were planning to turn on vnodes using the adding a new datacenter method

RE: Cassandra 1.1.6 - Disk usage and Load displayed in ring doesn't match

2013-12-16 Thread Arindam Barua
Do you have any snapshots on the nodes where you are seeing this issue? Snapshots will link to sstables which will cause them not be deleted. -Arindam From: Narendra Sharma [mailto:narendra.sha...@gmail.com] Sent: Sunday, December 15, 2013 1:15 PM To: user@cassandra.apache.org Subject:

RE: Config changes to leverage new hardware

2013-11-25 Thread Arindam Barua
Apache Cassandra Consulting http://www.thelastpickle.com On 21/11/2013, at 12:42 pm, Arindam Barua aba...@247-inc.commailto:aba...@247-inc.com wrote: Thanks for the suggestions Aaron. As a follow up, we ran a bunch of tests with different combinations of these changes on a 2-node ring

RE: Config changes to leverage new hardware

2013-11-20 Thread Arindam Barua
as well. It's easier to tune the system if you can provide some info on the workload. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 7/11/2013, at 12:35 pm, Arindam Barua aba...@247

RE: Getting into Too many open files issues

2013-11-07 Thread Arindam Barua
I see 100 000 recommended in the Datastax documentation for thenofile limit since Cassandra 1.2 : http://www.datastax.com/documentation/cassandra/2.0/webhelp/cassandra/install/installRecommendSettings.html -Arindam From: Pieter Callewaert [mailto:pieter.callewa...@be-mobile.be] Sent:

Config changes to leverage new hardware

2013-11-06 Thread Arindam Barua
We want to upgrade our Cassandra cluster to have newer hardware, and were wondering if anyone has suggestions on Cassandra or linux config changes that will prove to be beneficial. As of now, our performance tests (our application specific as well as cassandra-stress) are not showing any

RE: Heap almost full

2013-10-31 Thread Arindam Barua
data do you got per node ? - What is the value of the index_intval (cassandra.yaml) ? If you are trying to fix this, you can try : - changing the memtable_total_space_in_mb to 1024 - increasing the heap to 10GB. Hope this will help somehow :). Good luck 2013/10/16 Arindam Barua

RE: gc_grace_seconds to 0?

2013-10-23 Thread Arindam Barua
On 23/10/2013, at 1:08 PM, Arindam Barua aba...@247-inc.commailto:aba...@247-inc.com wrote: We are not doing deletes, but are setting ttls of 8 days on most of our columns (these are not updates to existing columns). Hence it seems safe to reduce gc_grace_seconds to even 0 from a tombstones

upgrading Cassandra server hardware best practice?

2013-10-18 Thread Arindam Barua
We currently have 2 datacenters and a ring of 5 Cassandra servers on each datacenter. We are getting new hardware, and after evaluating them, plan to upgrade the ring to the new hardware. Is there any recommended procedure for doing so? This is one of the options we are considering: 1.

RE: upgrading Cassandra server hardware best practice?

2013-10-18 Thread Arindam Barua
://www.datastax.com/docs/1.0/operations/cluster_management From: Robert Coli [mailto:rc...@eventbrite.com] Sent: Friday, October 18, 2013 11:50 AM To: user@cassandra.apache.org Subject: Re: upgrading Cassandra server hardware best practice? On Fri, Oct 18, 2013 at 11:39 AM, Arindam Barua aba

RE: about FlushWriter All time blocked

2013-10-17 Thread Arindam Barua
is three 1TB disks with software RAID 0, to appear as a single disk of 3TB. Does this confirm that I have a slow disk problem? If so, any other ways to help other than moving to SSDs and adding more Cassandra nodes. Thanks, Arindam From: Arindam Barua [mailto:aba...@247-inc.com] Sent: Monday

gc_grace_seconds to 0?

2013-10-16 Thread Arindam Barua
We don't do any deletes in our cluster, but do set ttls of 8 days on most of the columns. After reading a bunch of earlier threads, I have concluded that I can safely set gc_grace_seconds to 0 and not have to worry about expired columns coming back to life. However, I wanted to know if there

Heap almost full

2013-10-15 Thread Arindam Barua
During performance testing being run on our 4 node Cassandra 1.1.5 cluster, we are seeing warning logs about the heap being almost full - [1]. I'm trying to figure out why, and how to prevent it. The tests are being run on a Cassandra ring consisting of 4 dedicated boxes with 32 GB of RAM

RE: about FlushWriter All time blocked

2013-07-01 Thread Arindam Barua
and separately for both of course so you can see the effect). On Thu, Jun 27, 2013 at 2:27 AM, Arindam Barua aba...@247-inc.commailto:aba...@247-inc.com wrote: In our performance tests, we are seeing similar FlushWriter, MutationStage, MemtablePostFlusher pending tasks become non-zero. We collect

RE: Problems with node rejoining cluster

2013-06-28 Thread Arindam Barua
of cluster and check for a split schema using cassandra-cli (FAQ on the wiki has help for split schema) Cheers - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 27/06/2013, at 8:57 AM, Arindam Barua aba...@247

RE: about FlushWriter All time blocked

2013-06-27 Thread Arindam Barua
In our performance tests, we are seeing similar FlushWriter, MutationStage, MemtablePostFlusher pending tasks become non-zero. We collect snapshots every 5 minutes, and they seem to clear after ~10-15 minutes though. (The flush writer has an 'All time blocked' count of 540 in the below

RE: Problems with node rejoining cluster

2013-06-26 Thread Arindam Barua
...@eventbrite.com] Sent: Tuesday, June 25, 2013 11:15 AM To: user@cassandra.apache.org Subject: Re: Problems with node rejoining cluster On Mon, Jun 24, 2013 at 11:19 PM, Arindam Barua aba...@247-inc.com wrote: - We do not specify any tokens in cassandra.yaml relying on bootstrap

Problems with node rejoining cluster

2013-06-25 Thread Arindam Barua
We need to do a rolling upgrade of our Cassandra cluster in production, since we are upgrading Cassandra on solaris to Cassandra on CentOS. (We went with solaris initially since most of our other hosts in production are solaris, but were running into some lockup issues during perf tests, and

RE: Read latency issue

2012-10-12 Thread Arindam Barua
clients? Btw, using Hector's SliceQuery() and reading into a List, or Astynax seem to result in similar times too. Thanks, Arindam -Original Message- From: Arindam Barua [mailto:aba...@247-inc.com] Sent: Wednesday, October 03, 2012 10:54 AM To: user@cassandra.apache.org Subject: RE: Read

RE: Using compound primary key

2012-10-08 Thread Arindam Barua
Did you use the --cql3 option with the cqlsh command? From: Vivek Mishra [mailto:mishra.v...@gmail.com] Sent: Monday, October 08, 2012 7:22 PM To: user@cassandra.apache.org Subject: Using compound primary key Hi, I am trying to use compound primary key column name and i am referring to:

RE: Read latency issue

2012-10-03 Thread Arindam Barua
want to play with more nodes and re-run. If you run a test with PlayOrm, I would love to know the results there as well. Later, Dean From: Arindam Barua aba...@247-inc.commailto:aba...@247-inc.com Reply-To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user

RE: Read latency issue

2012-10-03 Thread Arindam Barua
. Anyways, you may want to play with more nodes and re-run. If you run a test with PlayOrm, I would love to know the results there as well. Later, Dean From: Arindam Barua aba...@247-inc.commailto:aba...@247-inc.commailto:aba...@247-inc.com%3cmailto:aba...@247-inc.com

Read latency issue

2012-10-01 Thread Arindam Barua
We are trying to setup a Cassandra cluster and have low read latency requirements. Running some tests, we do not see the performance that we were hoping for. Wanted to check if anyone has thoughts on: 1. If these are expected latency times for the data/machine config, etc 2. If