Re: Unable to remove dead node from cluster.

@Jeff, I just use jmx connect to one node, run the unsafeAssainateEndpoint, and pass in the "10.210.165.55" ip address. Yes, we have hundreds of other nodes in the nodetool status output as well. On Tue, Sep 22, 2015 at 11:31 PM, Jeff Jirsa wrote: > When you run unsafeAssassinateEndpoint, to wh

Re: How to tune Cassandra or Java Driver to get lower latency when there are a lot of writes?

I use Spark and spark-cassandra-connector with a customized Cassandra writer (spark-cassandra-connector doesn’t support DELETE). Basically the writer works as follows: - Bind a row in Spark RDD with either INSERT/Delete PreparedStatement - Create a BatchStatement for multiple rows - Write

Re: To batch or not to batch: A question for fast inserts

> I side-tracked some punctual benchmarks and stumbled on the observations of unlogged inserts being *A LOT* faster than the async counterparts. My own testing agrees very strongly with this. When this topic came up on this list before, there was a concern that batch coordination produces GC pres

Re: Currupt sstables when upgrading from 2.1.8 to 2.1.9

On Thu, Sep 24, 2015 at 3:00 PM, Robert Coli wrote: > A node which has lost a SSTable also needs to be repaired immediately. > Forgot to mention, you can repair via this technique : https://issues.apache.org/jira/browse/CASSANDRA-6961 =Rob

Re: Currupt sstables when upgrading from 2.1.8 to 2.1.9

On Tue, Sep 15, 2015 at 9:42 AM, Nate McCall wrote: > Either way, you are going to have to run nodetool scrub. I'm not sure if > it's better to do this from 2.1.8 or from 2.1.9 with "disk_failure_policy: > ignore" > A node which has lost a SSTable also needs to be repaired immediately. If it is

Re: Throttling Cassandra Load

Can Robert or anyone else want to take this and express thier views on our throttling approach ?  As I said, we would be moving to CQL Driver incrementally but that would take several months.So, we are trying to throttle Cassandra load based on rpc thrift interface and Hector as of now. Later

Re: How to tune Cassandra or Java Driver to get lower latency when there are a lot of writes?

How are you loading the data? I mean, what insert method are you using? On Thu, Sep 24, 2015 at 9:58 PM, Benyi Wang wrote: > I have a cassandra cluster provides data to a web service. And there is a > daily batch load writing data into the cluster. > >- Without the batch loading, the service

How to tune Cassandra or Java Driver to get lower latency when there are a lot of writes?

I have a cassandra cluster provides data to a web service. And there is a daily batch load writing data into the cluster. - Without the batch loading, the service’s Latency 99thPercentile is 3ms. But during the load, it jumps to 90ms. - I checked cassandra keyspace’s ReadLatency.99thPerce

Re: Seeing null pointer exception 2.0.14 after purging gossip state

On Mon, Sep 14, 2015 at 7:53 PM, K F wrote: > I have cassandra 2.0.14 deployed and after following the method described > in Apache Cassandra™ 2.0 > > to > clear the gossip state of the node in one of the dc o

Re: Regarding " node tool move "

On Thu, Sep 24, 2015 at 1:29 AM, Rock Zhang wrote: > on host A, if i run command "nodetool move -9096422322933500933" , what > gonna happen ? > Move data associated with token "-9096422322933500933" from where to where > ? > When you change the token of a node, you change the "range" it is a

Re: What is your backup strategy for Cassandra?

Since I'm running on AWS we wrote a script that for each column performs a snapshot and sync it on S3, and at the end of the script i'm also grabbing the node tokens and store them on S3. In case of restore i will use this procedure

RE: Deserialize the collection type data from the SSTable file

Hi, Daniel: I didn't find any branch related to C* 2.1 in the https://github.com/coursera/aegisthus, is there one? It looks like there are big changes in the C* 2.1 of collections API. Just want to know if there is any CQLMapper for C* 2.1 branch. Meantime, I will also try to understand more abo

Regarding " node tool move "

Hi All, I want to manually move some token from one hostA to host B, i do not fully understand this command, * move- Move node on the token ring to a new token* Say host A has token: (i got it with nodetool info -T) Token : -9096422322933500933 Token :

Re: Do vnodes need more memory?

On Thu, Sep 24, 2015 at 12:45 AM, Robert Coli wrote: > On Wed, Sep 23, 2015 at 7:09 AM, Tom van den Berge < > tom.vandenbe...@gmail.com> wrote: > >> So it seems that Cassandra simply doesn't have enough memory. I'm trying >> to understand if this can be caused by the use of vnodes? Is there an >>

Re: Huge amounts of hinted handoffs for counter table

Thank you for your time! Our replication factor is 'DC1': '2', 'DC2': '2'. Consistency is set to LOCAL_ONE for these queries. Indeed timeouts might be a problem as some of the nodes in DC2 are under high load from time to time. Is there some counter (eg. JMX or so) I could monitor to verify this