Hi Mani, I don't know what can cause this. Do you see the same thing if you schedule less jobs, like 100 instead of 30000?
The worker actor in the sample is only accepting one job at a time, so if the execution time is about the same for each job you should see roughly same number of jobs executed by each worker. Do you mean that one worker is executing, and the others are idle waiting even though there are jobs in the master queue? Regards, Patrik On Tue, Oct 14, 2014 at 10:12 PM, Manikandan Kaliyaperumal < [email protected]> wrote: > Hi, > > I have created Distributed Akka Workers/Master cluster in java and exactly > followed this typesafe template. > https://github.com/typesafehub/activator-akka-distributed-workers > > I have the following configurations: > > One master and one backup master - each running on a separate node - node1 > & node2 > 4 workers - running on two nodes - node1 & node2 > > I am currently testing this setup in QA and we are seeing some issues in: > > 1. Looks like all 4 workers are not doing the work parallel - the Master > --> Worker work assignment is sticking with one worker for a while and then > switching to other worker for a while - both are not getting work parallel > > 2. WE have 30000 works scheduled to the master through the frontend - it > is taking almost 24 hours to finish all the jobs. > > Is there anything that am i doing wrong - how to fine tune this to make it > pure parallel and speed up the jobs execution? > > Any pointers and help on this would be highly appreciated. > > Worker conf: > ---------------- > akka { > > actor.provider = "akka.remote.RemoteActorRefProvider" > #actor.provider = "akka.cluster.ClusterActorRefProvider" > > remote.netty.tcp.port=0 > remote.netty.tcp.hostname=${?http.address} > > } > > contact-points = [ > "akka.tcp://[email protected]:2561", > "akka.tcp://[email protected]:2562"] > > Master conf: > ---------------- > akka { > actor { > provider = "akka.cluster.ClusterActorRefProvider" > } > remote { > #log-remote-lifecycle-events = off > netty.tcp { > hostname = ${?http.address} > port = 0 > } > } > cluster { > seed-nodes = [ > "akka.tcp://[email protected]:2561", > "akka.tcp://[email protected]:2562"] > > auto-down-unreachable-after = 10s > } > extensions = ["akka.contrib.pattern.ClusterReceptionistExtension"] > persistence { > journal.plugin = "akka.persistence.journal.leveldb-shared" > journal.leveldb-shared.store { > # DO NOT USE 'native = off' IN PRODUCTION !!! > #native = off > dir = "/fasejobs/quote/shared-journal" > } > snapshot-store.local.dir = "/fasejobs/quote/snapshots" > } > } > > Play akka parallelism config: > ------------------------------------- > play { > akka { > loggers = ["akka.event.Logging$DefaultLogger"] > actor { > default-dispatcher = { > fork-join-executor { > parallelism-factor = 50 > parallelism-min = 100 > parallelism-max = 300 > } > } > } > } > } > > Thanks, > Mani > > -- > >>>>>>>>>> Read the docs: http://akka.io/docs/ > >>>>>>>>>> Check the FAQ: > http://doc.akka.io/docs/akka/current/additional/faq.html > >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user > --- > You received this message because you are subscribed to the Google Groups > "Akka User List" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > Visit this group at http://groups.google.com/group/akka-user. > For more options, visit https://groups.google.com/d/optout. > -- Patrik Nordwall Typesafe <http://typesafe.com/> - Reactive apps on the JVM Twitter: @patriknw -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.
