I was able utilize full performance with a
fork-join-executor {
parallelism-min = 0
parallelism-factor = 2
parallelism-max = 64
}
for the extractor and using the
fork-join-executor {
parallelism-min = 0
parallelism-factor = 10.0
parallelism-max = 128
}
on the calculations in step 2+3.
Sorry for bothering you!
On Friday, September 5, 2014 10:57:56 AM UTC-7, Malte wrote:
>
> Hi,
>
> I just started using Akka and am writing an application that consists of
> three layers - extracting tar files -> reading the extracted json files ->
> writing it to Cassandra. Because it so very step based I figured Akka would
> be a good fit.
>
> I use the default settings and three sub-workers:
>
> val converterRouter = context.actorOf(Props(new ToJson(new File(path +
> "/error/"))).withRouter(RoundRobinRouter(10)), name = "converterRouter")
> val cassandraRouter = context.actorOf(Props(new
> ToCassandra()).withRouter(RoundRobinRouter(10)), name = "cassandraRouter")
> val extractRouter = context.actorOf(Props(new
> Extract()).withRouter(RoundRobinRouter(10)), name = "extractRouter")
>
> Since this is a long batch processing I would like to really "fire it up"
> and use the full potential of my system (Macbook Pro / 16GB Ram / 4 Core)
> but instead of seeing 800% CPU usage I only get around 100-150%. Disk usage
> does not seem to be a problem since I am only seeing around 20-30mb/s data
> read/written. Any recommendations?
>
> Yours
>
> Malte
>
--
>>>>>>>>>> Read the docs: http://akka.io/docs/
>>>>>>>>>> Check the FAQ:
>>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user
---
You received this message because you are subscribed to the Google Groups "Akka
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at http://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.
