There's also been discussion on this topic before so looking/searching in the archives could be highly fruitful. On Feb 3, 2014 10:10 PM, "Patrik Nordwall" <[email protected]> wrote:
> Are you using auto-down? > In 2.3.0-RC2 you can configure auto-down-unreachable-after to a longer > period, or not configure it at all (default off) and use some > external/manual downing strategy. > > /Patrik > > > On Mon, Feb 3, 2014 at 9:45 PM, √iktor Ҡlang <[email protected]>wrote: > >> >> >> >> On Mon, Feb 3, 2014 at 9:36 PM, Zoran Jeremic <[email protected]>wrote: >> >>> >>> Thanks. I'll update the version of akka and try but it will take some >>> time until I can reach the same node unreachable state. BTW, is there some >>> way I can simulate this, e.g. to turn on firewall on server instance to >>> block the communication all all ports? >>> >> >> There is a blackhole function in the test conductor for the distributed >> multinode tests. >> >> >>> >>> >>> >If you spawn the actors on the nodes, and those actors die because that >>> node goes down, what would you expect who to do? >>> >Or did I misunderstand? >>> These actors on slave node do not die actually. It seems that slave node >>> becomes unreachable for some long time, but it's still working and I can >>> still perform some actions on it, and actors continue to process web pages. >>> >> >> Unreachability and death is undistinguishable in a distributed system. >> Perhaps you should just revisit your Akka configuration? >> >> >>> Each crawling job running on one node is supposed to be independent on >>> other nodes and actors. It doesn't call any actor on the other node, so I >>> would like this node to continue the jobs he is working on until it's >>> finished. After, finished crawling of several hundred thousands of web >>> pages, I don't want to interrupt this job, but to continue working on. And >>> what I just guess as the problem is that these actors being on the same >>> node are using absolute path that refers to the System created on master >>> node. >>> If I understood Akka documentation well, once the node becomes >>> unreachable it creates it's own (new) cluster and runs in it. So, why then >>> these communication between actors in this new cluster is performed through >>> the cluster which is not reachable any more. >>> >> >> When Tom Hank's character got stuck on that deserted island in "Cast >> Away" — after a while he was declared dead his wife had to move on (and his >> stuff was most likely given away as per his last will and testament) you >> can't "roll-back" such things. Same goes for Actors: Once a node is >> considered to be dead, it needs to stay dead. We don't want >> zombie-nodes—zombies are dangerous! >> >> >>> >>> >>> >>> >>> On Monday, 3 February 2014 12:13:55 UTC-8, √ wrote: >>> >>>> Please update to 2.3.0-RC2 >>>> >>>> If you spawn the actors on the nodes, and those actors die because that >>>> node goes down, what would you expect who to do? >>>> Or did I misunderstand? >>>> >>>> >>>> On Mon, Feb 3, 2014 at 9:06 PM, Zoran Jeremic <[email protected]>wrote: >>>> >>>>> Hi Victor, >>>>> >>>>> It's 2.3-M1. >>>>> >>>>> Zoran >>>>> >>>>> >>>>> On Monday, 3 February 2014 11:53:27 UTC-8, √ wrote: >>>>> >>>>>> What version are you running? >>>>>> >>>>>> >>>>>> On Mon, Feb 3, 2014 at 8:46 PM, Zoran Jeremic <[email protected]>wrote: >>>>>> >>>>>>> Hi, >>>>>>> >>>>>>> I'm implementing Web sites crawler using Akka clustering. I have one >>>>>>> node that plays the role of master node where cluster is initialized >>>>>>> from >>>>>>> the ClusterControllerActor in the following way: >>>>>>> >>>>>>> int totalInstances = 2; >>>>>>>> int maxInstancesPerNode = 1; >>>>>>>> boolean allowLocalRoutees = true; >>>>>>>> String useRole = null; >>>>>>>> AdaptiveLoadBalancingPool pool = new >>>>>>>> AdaptiveLoadBalancingPool( >>>>>>>> MixMetricsSelector.getInstance(), 0); >>>>>>>> ClusterRouterPoolSettings settings = new >>>>>>>> ClusterRouterPoolSettings( >>>>>>>> totalInstances, maxInstancesPerNode, >>>>>>>> allowLocalRoutees, useRole); >>>>>>>> crawlerManager = getContext().actorOf( >>>>>>>> new ClusterRouterPool(pool, >>>>>>>> settings).props(Props.create( >>>>>>>> CrawlerManagerActor.class, getSelf())), >>>>>>>> "crawlerManager"); >>>>>>> >>>>>>> >>>>>>> >>>>>>> Other nodes play the role of slaves, and each node in cluster has >>>>>>> one CrawlerManagerActor created from master node in >>>>>>> AdaptiveLoadBalancingPool. For each crawling job (Web site to be >>>>>>> crawled) I >>>>>>> create one job that is delegated to the one of the CrawlingManagers >>>>>>> based >>>>>>> on MixMetricsSelector, and one job is running only on one node. >>>>>>> CrawlerManager creates a set of actors that works together on dedicated >>>>>>> task. After the job was finished, these actors are stopped and killed. >>>>>>> This >>>>>>> works pretty fine, until the moment when slave node is disconnected from >>>>>>> cluster. I don't know why the slave node is disconnected after 24-48 >>>>>>> hours >>>>>>> of successful work (I'm hosting it on 2 Microsoft Azure instances with >>>>>>> Tomcat), but once this happen I have a plenty of errors, e.g.: >>>>>>> >>>>>>> akka.pattern.AskTimeoutException: Recipient[Actor[akka://Cluster >>>>>>>> System/remote/akka.tcp/[email protected]:2551/ >>>>>>>> user/clusterController/crawlerManager/c2/$c/statisticsServic >>>>>>>> e#-1293629832]] had already been terminated. >>>>>>> >>>>>>> >>>>>>> statisticService that is referred here is actually running on the >>>>>>> slave node and is referred from slave node on the address >>>>>>> xxx.xxx.xxx.66:2552, but it's referred through the clusterController >>>>>>> which >>>>>>> is initialized on master node, so StatisticServiceActor running on node >>>>>>> xxx.xxx.xxx.66:2552 has the path: >>>>>>> >>>>>>> akka://ClusterSystem/remote/akka.tcp/[email protected]. >>>>>>>> xxx.69:2551/user/clusterController/crawlerManager/c2/$a/stat >>>>>>>> isticsService >>>>>>> >>>>>>> >>>>>>> I would like to make these actors (CrawlerManager and all other >>>>>>> nodes created for each individual job and running on one node instance) >>>>>>> to >>>>>>> be able to continue running and finishing job even if node is >>>>>>> disconnected >>>>>>> from cluster, so this is not what I'm expecting and what I want. I'm not >>>>>>> sure if this is expected behaviour or I missed to do something, but I >>>>>>> hope >>>>>>> somebody will have an idea how I could resolve this. >>>>>>> >>>>>>> Thanks, >>>>>>> Zoran >>>>>>> >>>>>>> -- >>>>>>> >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>> >>>>>>>>>> Check the FAQ: http://akka.io/faq/ >>>>>>> >>>>>>>>>> Search the archives: https://groups.google.com/grou >>>>>>> p/akka-user >>>>>>> --- >>>>>>> You received this message because you are subscribed to the Google >>>>>>> Groups "Akka User List" group. >>>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>>> send an email to [email protected]. >>>>>>> To post to this group, send email to [email protected]. >>>>>>> >>>>>>> Visit this group at http://groups.google.com/group/akka-user. >>>>>>> For more options, visit https://groups.google.com/groups/opt_out. >>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Cheers, >>>>>> √ >>>>>> >>>>>> * ——————— **Viktor Klang* >>>>>> *Chief Architect - **Typesafe <http://www.typesafe.com/>* >>>>>> >>>>>> Twitter: @viktorklang >>>>>> >>>>> -- >>>>> >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>> >>>>>>>>>> Check the FAQ: http://akka.io/faq/ >>>>> >>>>>>>>>> Search the archives: https://groups.google.com/ >>>>> group/akka-user >>>>> --- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "Akka User List" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to [email protected]. >>>>> To post to this group, send email to [email protected]. >>>>> Visit this group at http://groups.google.com/group/akka-user. >>>>> For more options, visit https://groups.google.com/groups/opt_out. >>>>> >>>> >>>> >>>> >>>> -- >>>> Cheers, >>>> √ >>>> >>>> * ——————— **Viktor Klang* >>>> *Chief Architect - **Typesafe <http://www.typesafe.com/>* >>>> >>>> Twitter: @viktorklang >>>> >>> -- >>> >>>>>>>>>> Read the docs: http://akka.io/docs/ >>> >>>>>>>>>> Check the FAQ: http://akka.io/faq/ >>> >>>>>>>>>> Search the archives: >>> https://groups.google.com/group/akka-user >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "Akka User List" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> To post to this group, send email to [email protected]. >>> Visit this group at http://groups.google.com/group/akka-user. >>> For more options, visit https://groups.google.com/groups/opt_out. >>> >> >> >> >> -- >> Cheers, >> √ >> >> * ——————— **Viktor Klang* >> *Chief Architect - **Typesafe <http://www.typesafe.com/>* >> >> Twitter: @viktorklang >> >> -- >> >>>>>>>>>> Read the docs: http://akka.io/docs/ >> >>>>>>>>>> Check the FAQ: http://akka.io/faq/ >> >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user >> --- >> You received this message because you are subscribed to the Google Groups >> "Akka User List" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected]. >> To post to this group, send email to [email protected]. >> Visit this group at http://groups.google.com/group/akka-user. >> For more options, visit https://groups.google.com/groups/opt_out. >> > > > > -- > > Patrik Nordwall > Typesafe <http://typesafe.com/> - Reactive apps on the JVM > Twitter: @patriknw > > -- > >>>>>>>>>> Read the docs: http://akka.io/docs/ > >>>>>>>>>> Check the FAQ: http://akka.io/faq/ > >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user > --- > You received this message because you are subscribed to the Google Groups > "Akka User List" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > Visit this group at http://groups.google.com/group/akka-user. > For more options, visit https://groups.google.com/groups/opt_out. > -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: http://akka.io/faq/ >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/groups/opt_out.
