Is Repair complete?

2017-01-04 Thread Shannon Carey
Can anyone give a better answer to the question "How do I know if a "nodetool repair" is finished?" on http://stackoverflow.com/questions/25064717/how-do-i-know-if-nodetool-repair-is-finished I am trying to prepare to upgrade to DSE 5. I am migrating to incremental repairs first. So I disabled

ONE has much higher latency than LOCAL_ONE

2017-03-21 Thread Shannon Carey
I am seeing unexpected behavior: consistency level ONE increases read latency 99th percentile to ~108ms (95th percentile to 5ms-90ms) up from ~5ms (99th percentile) when using LOCAL_ONE. I am using DSE 5.0 with Datastax client 3.0.0. The client is configured with a TokenAwarePolicy wrapping a

Re: ONE has much higher latency than LOCAL_ONE

2017-03-22 Thread Shannon Carey
sers <user@cassandra.apache.org<mailto:user@cassandra.apache.org>> Subject: Re: ONE has much higher latency than LOCAL_ONE On Wed, Mar 22, 2017 at 1:11 PM, Nate McCall <n...@thelastpickle.com<mailto:n...@thelastpickle.com>> wrote: On Wed, Mar 22, 2017 at 12:48 PM,

Re: ONE has much higher latency than LOCAL_ONE

2017-03-22 Thread Shannon Carey
/cassandra/dml/dml_config_consistency_c.html Regards, Eric On Tue, Mar 21, 2017 at 7:49 PM Shannon Carey <sca...@expedia.com<mailto:sca...@expedia.com>> wrote: The cluster is in two DCs, and yes the client is deployed locally to each DC. From: Matija Gobec <matija0...@gmail

Re: ONE has much higher latency than LOCAL_ONE

2017-03-23 Thread Shannon Carey
Thanks for the link, I hadn't seen that before. It's unfortunate that they don't explain what they mean by "closest replica". The nodes in the remote DC should not be regarded as "closest". Also, it's not clear what the black arrows mean… the coordinator sends the read to all three replicas,

Re: Consistency Level vs. Retry Policy when no local nodes are available

2017-03-20 Thread Shannon Carey
if there's not a quorum in either DC (as would happen if one DC goes down). So it seems like we are forced to use a lesser consistency such as ONE or TWO. -Shannon From: Shannon Carey <sca...@expedia.com<mailto:sca...@expedia.com>> Date: Monday, March 20, 2017 at 5:25

Re: ONE has much higher latency than LOCAL_ONE

2017-03-21 Thread Shannon Carey
ning a multi DC cluster? If yes do you have application in both data centers/regions ? On Tue, Mar 21, 2017 at 8:07 PM, Shannon Carey <sca...@expedia.com<mailto:sca...@expedia.com>> wrote: I am seeing unexpected behavior: consistency level ONE increases read latency 99th percentile to

Re: Consistency Level vs. Retry Policy when no local nodes are available

2017-03-21 Thread Shannon Carey
n it becomes available (with missing data) or wait until it catches up on writes (and how do you know when that has happened)? Note also QUORUM is a clear majority of replicas across both DCs. Some people run 3 DCs with RF 3 in each and QUORUM to maintain strong consistency across DCs even with