Re: Dependency Hell: STORM 0.9.2 and Cassandra 2.0

2014-10-25 Thread Ben Bromhead
I haven't had to deal with this problem specifically and don't know if there is a storm specific solution, but the general Java way of dealing with projects who have conflicting dependencies would be to either exclude one of the conflicting dependencies using maven and see if it works, otherwise

Bootstrapping new node overloads cpu on existing nodes

2014-10-25 Thread aivanov
‎Dear all, ‎So, here is our setup so far:  - Ubuntu 12.04  - Cassandra 2.0.10, JDK 1.7.0_65-b17  - 6 nodes (EC2 c3.8xlarge/ 32 cores/60GB RAM, EBS disks for data,    ephemeral SSD for commit logs etc)  - pretty heavy write load - 100Ks/second  - RF=2, one dc, 2 racks  - everything works just

Re: Bootstrapping new node overloads cpu on existing nodes

2014-10-25 Thread Jens Rantil
Just to clarify, does adding node include initiating a repair for the cluster? Or you are simply bootstrapping a new node, nothing else? — Sent from Mailbox On Sat, Oct 25, 2014 at 2:38 PM, null aiva...@iponweb.net wrote: ‎Dear all, ‎So, here is our setup so far:  - Ubuntu 12.04  -

Re: Bootstrapping new node overloads cpu on existing nodes

2014-10-25 Thread aivanov
No, simply bootstrapping. Basically, as soon as the new node starts joining load average spikes like x10 And it's not like the load comes from streaming (judging from what I see in visualvm), it's writes that start taking much more cpu, mostly for nio socket select. От: Jens Rantil

OOM at Bootstrap Time

2014-10-25 Thread Maxime
Hello, I've been trying to add a new node to my cluster ( 4 nodes ) for a few days now. I started by adding a node similar to my current configuration, 4 GB or RAM + 2 Cores on DigitalOcean. However every time, I would end up getting OOM errors after many log entries of the type: INFO

Re: OOM at Bootstrap Time

2014-10-25 Thread Laing, Michael
Since no one else has stepped in... We have run clusters with ridiculously small nodes - I have a production cluster in AWS with 4GB nodes each with 1 CPU and disk-based instance storage. It works fine but you can see those little puppies struggle... And I ran into problems such as you

Re: OOM at Bootstrap Time

2014-10-25 Thread Maxime
Thanks a lot that is comforting. We are also small at the moment so I definitely can relate with the idea of keeping small and simple at a level where it just works. I see the new Apache version has a lot of fixes so I will try to upgrade before I look into downgrading. On Saturday, October 25,

Converting from ST to LeveledCompaction

2014-10-25 Thread Jay Patel
Hi, We converted column families from ST to Leveled Compaction strategy, but build-in secondary indexes are not converted to Leveled Compaction. Is there any specific parameter we need to define for Indexes or will it derive compaction strategy from the primary table OR, Do we need to rebuild

which snitch ?

2014-10-25 Thread Srinivas Chamarthi
I am using a datacenter in private network and want to replicate data to an ec2 data center. I am confused which snitch to use so that my data in the dc1 is replicated to dc2 in ec2 ? any help is greatly appreciated thx srinivas

Re: which snitch ?

2014-10-25 Thread Arun
Srinivas, Use ec2multiregion snitch. On Oct 25, 2014, at 19:47, Srinivas Chamarthi srinivas.chamar...@gmail.com wrote: I am using a datacenter in private network and want to replicate data to an ec2 data center. I am confused which snitch to use so that my data in the dc1 is