Re: Nodes go down periodically

2016-02-23 Thread Joel Samuelsson
t;>>> You didn’t mention version, but I saw this kind of thing very often in >>>> the 1.1 line. Often this is connected to network flakiness. Are these VMs? >>>> In the cloud? Connected over a WAN? You mention that ping seems fine. Take >>>>

Re: Nodes go down periodically

2016-02-23 Thread daemeon reiydelle
twork flakiness. Are these VMs? >>> In the cloud? Connected over a WAN? You mention that ping seems fine. Take >>> a look at the phi_convict_threshold in c assandra.yaml. You may need to >>> increase it to reduce the UP/DOWN flapping behavior. >>> >>> >

Re: Nodes go down periodically

2016-02-23 Thread Jack Krupansky
* Joel Samuelsson [mailto:samuelsson.j...@gmail.com] >> *Sent:* Tuesday, February 23, 2016 9:41 AM >> *To:* user@cassandra.apache.org >> *Subject:* Re: Nodes go down periodically >> >> >> >> Hi, >> >> >> >> Thanks for your reply. >

Re: Nodes go down periodically

2016-02-23 Thread Joel Samuelsson
P/DOWN flapping behavior. > > > > > > Sean Durity > > > > *From:* Joel Samuelsson [mailto:samuelsson.j...@gmail.com] > *Sent:* Tuesday, February 23, 2016 9:41 AM > *To:* user@cassandra.apache.org > *Subject:* Re: Nodes go down periodically > > > > Hi, &

RE: Nodes go down periodically

2016-02-23 Thread SEAN_R_DURITY
to increase it to reduce the UP/DOWN flapping behavior. Sean Durity From: Joel Samuelsson [mailto:samuelsson.j...@gmail.com] Sent: Tuesday, February 23, 2016 9:41 AM To: user@cassandra.apache.org Subject: Re: Nodes go down periodically Hi, Thanks for your reply. I have debug logging on and see

Re: Nodes go down periodically

2016-02-23 Thread Joel Samuelsson
Hi, Thanks for your reply. I have debug logging on and see no GC pauses that are that long. GC pauses are all well below 1s and 99 times out of 100 below 100ms. Do I need to enable GC log options to see the pauses? I see plenty of these lines: DEBUG [ScheduledTasks:1] 2016-02-22 10:43:02,891

Re: Nodes go down periodically

2016-02-23 Thread Hannu Kröger
Hi, Those are probably GC pauses. Memory tuning is probably needed. Check the parameters that you already have customised if they make sense. http://blog.mikiobraun.de/2010/08/cassandra-gc-tuning.html Hannu > On 23 Feb 2016, at