On Wed, Apr 22, 2015 at 9:26 AM, Anders Båtstrand <[email protected]> wrote:
> After some investigations I found that the memory was all used by the > internal buffer in ClusterSingletonProxy. > Great, that explains it. > I will solve that (I guess) by using a bounded mailbox instead of the > default. > It is using Stash so you should be able to configure an appropriate stash-capacity. Note that we have a ticket for making this buffering optional: https://github.com/akka/akka/issues/15110 > > I am still confused by the cluster size issue, though. The node was > obviously busy sending messages to the cluster singleton, but could this > cause the system-messages needed for detecting cluster problems to wait? Is > there a priority for messages here? > > And even if the system-messages had to wait, should not the internal clock > detect that it had not heard from the other nodes, and act on that? > Node 1 and 3 detected that 2 was unreachable because they did not receive heartbeat replies from it. Probably you are also using auto-down, since you said that node 2 was removed from 1 and 3. Node 2 was completely swamped with trying to free memory, garbage collecting, so it was not able to anything else, i.e. it was not even able to detect that 1 and 3 are unreachable. By running with DEBUG log level you can see when the heartbeat messages are sent and received. /Patrik > > Regards, > > Anders > > -- > >>>>>>>>>> Read the docs: http://akka.io/docs/ > >>>>>>>>>> Check the FAQ: > http://doc.akka.io/docs/akka/current/additional/faq.html > >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user > --- > You received this message because you are subscribed to the Google Groups > "Akka User List" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > Visit this group at http://groups.google.com/group/akka-user. > For more options, visit https://groups.google.com/d/optout. > -- Patrik Nordwall Typesafe <http://typesafe.com/> - Reactive apps on the JVM Twitter: @patriknw -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.
