"light load" - I mean average cpu utilization is about 6-8%, with spikes to 30% - at least that is what NewRelic reports. I don't have gc times logging enabled but "Garbage collection CPU time" stays below 0.5% I send few messages per second, less than 10 - all are small, less that few hunderd bytes. I'll try with changing akka.cluster.failure-detector.acceptable-heartbeat-pause to see if it makes a difference. Thanks!
W dniu czwartek, 26 marca 2015 14:10:29 UTC+1 użytkownik Patrik Nordwall napisał: > > > > On Wed, Mar 25, 2015 at 8:59 AM, Marek Żebrowski <[email protected] > <javascript:>> wrote: > >> I'm trying to run small cluster, just 3 nodes on EC2. >> I configured dispatchers and increased threshold for failure detector as >> recommended >> >> { >> >> cluster { >> use-dispatcher = cluster-dispatcher >> failure-detector { >> threshold = 12 >> } >> auto-down-unreachable-after = 10s >> retry-unsuccessful-join-after = 5s >> } >> } >> >> cluster-dispatcher { >> type = "Dispatcher" >> executor = "fork-join-executor" >> fork-join-executor { >> parallelism-min = 2 >> parallelism-max = 4 >> } >> } >> >> >> >> >> >> but even tough my nodes are under light load I observe about 600-800 >> UNREACHABLE events >> >> WARN a.c.ClusterCoreDaemon: Cluster Node [akka.tcp:// >> [email protected]:2552] - Marking node(s) as UNREACHABLE >> [Member(address = akka.tcp:// [email protected]:2555, status = Up)] >> >> a day, and occasional quarantaines. >> >> >> I'd be grateful for recommendations about running akka cluster on EC2 >> >> > First thing you should try is to increase the > akka.cluster.failure-detector.acceptable-heartbeat-pause to for example > 10s. Default is 3s. > > Have you monitored garbage collection? Any long gc pauses? > > What does your application do "under light load"? Sending any large remote > messages? Sending many remote messages without flow control? > > Regards, > Patrik > >> >> >> -- >> >>>>>>>>>> Read the docs: http://akka.io/docs/ >> >>>>>>>>>> Check the FAQ: >> http://doc.akka.io/docs/akka/current/additional/faq.html >> >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user >> --- >> You received this message because you are subscribed to the Google Groups >> "Akka User List" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected] <javascript:>. >> To post to this group, send email to [email protected] >> <javascript:>. >> Visit this group at http://groups.google.com/group/akka-user. >> For more options, visit https://groups.google.com/d/optout. >> > > > > -- > > Patrik Nordwall > Typesafe <http://typesafe.com/> - Reactive apps on the JVM > Twitter: @patriknw > > -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.
