Wow, you have 500 CPU cores on your machine?
--
Cheers,
√
On Feb 16, 2016 5:01 PM, "Hareesh Jagannathan" <[email protected]> wrote:
> Thanks for responding quickly. Attaching a screeshot form visual Vm. As
> you can see there are more than 700 dispatcher for one my system.
>
> My design is as below.
>
> 1. The system is created once when application starts.
> 2. Many DAG/workflow which is basically a pipeline of actor/routers
> are create when a job is submitted.
> 3. when job is done the actors/routers of this pipeline is poison
> pilled. Sytem is never sutdown.
>
> Below is config for this system
>
> worker {
> akka {
> actor {
> default-dispatcher {
> fork-join-executor {
> parallelism-factor = 48.0
> parallelism-max = 512
> }
> }
> }
> }
>
> bestselling-cache-timeout = 120000
>
> pool-size {
> bestbuy {
> full {
> skusFromPageFetcher = 10
> skuTransformer = 120
> solrXmlPublisher = 70
> skuXmlPersistor = 60
> }
> reindex {
> solrAllXmlFetcher = 50
> solrXmlPublisher = 250
> }
> sku_refresh {
> skuIdListFetcher = 10
> skuTransformer = 120
> postSolrXmlFilter = 90
> solrXmlPublisher = 20
> skuXmlPersistor = 20
> }
> delta {
> skuTransformer = 30
> solrXmlPublisher = 20
> skuXmlPersistor = 20
> }
> autocomplete_full {
> suggestionFetcher = 10
> suggestionToSolrDocTransformer = 10
> suggestionPublisher = 20
> suggestionSolrDocPersistor = 10
> }
> autocomplete_delta {
> suggestionFetcher = 10
> suggestionToSolrDocTransformer = 10
> suggestionPublisher = 20
> suggestionSolrDocPersistor = 10
> }
> autocomplete_reindex {
> suggestionFetcher = 10
> suggestionPublisher = 20
> }
> }
> pacsales {
> full {
> skusFromPageFetcher = 3
> skuTransformer = 20
> solrXmlPublisher = 10
> skuXmlPersistor = 10
> }
> reindex {
> solrAllXmlFetcher = 5
> solrXmlPublisher = 30
> }
> }
> }
> }
>
>
>
>
>
>
> On Tuesday, February 16, 2016 at 9:33:17 AM UTC-6, Hareesh Jagannathan
> wrote:
>>
>> Akka application spins a lot of new dispatchers overtime instead of
>> reusing . The old dispatchers are going back to waiting state and never
>> been reused or terminated.
>>
>> We use akka's default dispatcher with fork-join executors. we do override
>> the default parallelism parameter between our actors based on actors
>> purpose.
>>
>> Is there a configuration that we are missing that causing this issue?
>>
> --
> >>>>>>>>>> Read the docs: http://akka.io/docs/
> >>>>>>>>>> Check the FAQ:
> http://doc.akka.io/docs/akka/current/additional/faq.html
> >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user
> ---
> You received this message because you are subscribed to the Google Groups
> "Akka User List" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [email protected].
> To post to this group, send email to [email protected].
> Visit this group at https://groups.google.com/group/akka-user.
> For more options, visit https://groups.google.com/d/optout.
>
--
>>>>>>>>>> Read the docs: http://akka.io/docs/
>>>>>>>>>> Check the FAQ:
>>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user
---
You received this message because you are subscribed to the Google Groups "Akka
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.
