It was probably a GC pause. It's good to run with gc logging enabled if you don't have that already.
You can increase acceptable-heartbeat-pause of the failure detector. /Patrik lör 6 maj 2017 kl. 18:06 skrev Idar Borlaug <[email protected]>: > That was what i thought as well. There might have been other activity on > the server that took the other cores. But this lasted for atleast 3-5 > minutes, until the akka cluster disconnected. > > Is there a way to tell java to prioritize akka heartbeat threads? > > Since this was a virtualmachine my vm could have had excessive pauses as > well. We have too little surveillance to debug this after it happend.. > > > On Sat, May 6, 2017 at 6:00 PM Patrik Nordwall <[email protected]> > wrote: > >> Ok, strange that one thread could disturb heartbeating, if you had plenty >> of cores. >> lör 6 maj 2017 kl. 17:54 skrev Idar Borlaug <[email protected]>: >> >>> The xls thread has nothing to do with akka at all. It just runs in the >>> same vm as our akka cluster. But it took resources so that akka didn't get >>> heartbeat messages in time. >>> >>> Other parts of the application created akka remoting messages as normal. >>> We send a few events across every second, small messages around 10-20 per >>> second. >>> >>> On Sat, 6 May 2017, 17:06 Patrik Nordwall, <[email protected]> >>> wrote: >>> >>>> Was the file sent over Akka remoting (actor messages), or generated >>>> other messages that were sent over remoting? >>>> >>>> /Patrik >>>> mån 24 apr. 2017 kl. 08:56 skrev Idar Borlaug <[email protected]>: >>>> >>>>> Hi >>>>> >>>>> We are using akka 2.4.11. I have an jetty web application with 3 >>>>> members in an akka cluster. >>>>> >>>>> When someone uploaded an excel file and i tried to read it with apache >>>>> poi. new XSSFWorkbook(inputstream), the akka cluster disconnected and >>>>> didn't reconnect before we restarted the jetty process. >>>>> the excel file had 1 mill empty row so it took well over a minute to >>>>> read the file. >>>>> >>>>> The problem i am having is how one such upload can stop akka >>>>> heartbeats from being sent? We are using vmware esx some version with 6 >>>>> cpus. Should be plenty of cpu power on the server. Other processes were >>>>> running fine. >>>>> >>>>> I have changed the failuredetector: >>>>> cluster.failure-detector.threshold = 16 >>>>> >>>>> Are we doing something wrong? >>>>> -- >>>>> Idar Borlaug >>>>> >>>>> -- >>>>> >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>> >>>>>>>>>> Check the FAQ: >>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>> >>>>>>>>>> Search the archives: >>>>> https://groups.google.com/group/akka-user >>>>> --- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "Akka User List" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to [email protected]. >>>>> To post to this group, send email to [email protected]. >>>>> Visit this group at https://groups.google.com/group/akka-user. >>>>> For more options, visit https://groups.google.com/d/optout. >>>>> >>>> -- >>>> >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>> >>>>>>>>>> Check the FAQ: >>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>> >>>>>>>>>> Search the archives: >>>> https://groups.google.com/group/akka-user >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "Akka User List" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to [email protected]. >>>> To post to this group, send email to [email protected]. >>>> Visit this group at https://groups.google.com/group/akka-user. >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> -- >>> Idar Borlaug >>> >>> -- >>> >>>>>>>>>> Read the docs: http://akka.io/docs/ >>> >>>>>>>>>> Check the FAQ: >>> http://doc.akka.io/docs/akka/current/additional/faq.html >>> >>>>>>>>>> Search the archives: >>> https://groups.google.com/group/akka-user >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "Akka User List" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> To post to this group, send email to [email protected]. >>> Visit this group at https://groups.google.com/group/akka-user. >>> For more options, visit https://groups.google.com/d/optout. >>> >> -- >> >>>>>>>>>> Read the docs: http://akka.io/docs/ >> >>>>>>>>>> Check the FAQ: >> http://doc.akka.io/docs/akka/current/additional/faq.html >> >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user >> --- >> You received this message because you are subscribed to the Google Groups >> "Akka User List" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected]. >> To post to this group, send email to [email protected]. >> Visit this group at https://groups.google.com/group/akka-user. >> For more options, visit https://groups.google.com/d/optout. >> > -- > Idar Borlaug > > -- > >>>>>>>>>> Read the docs: http://akka.io/docs/ > >>>>>>>>>> Check the FAQ: > http://doc.akka.io/docs/akka/current/additional/faq.html > >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user > --- > You received this message because you are subscribed to the Google Groups > "Akka User List" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > Visit this group at https://groups.google.com/group/akka-user. > For more options, visit https://groups.google.com/d/optout. > -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.
