Re: [akka-user] Re: Akka | Work - Pull pattern running into problem !

2017-10-13 Thread Justin du coeur 
Yeah -- this approach (which is fairly common) tends to mask the underlying
problem until things get a little more pathological, and then you just get
a bigger explosion...

On Thu, Oct 12, 2017 at 4:20 PM, Bwmat  wrote:

> If, on average, your producers Don't outrun your producers, and only do so
> in limited bursts, you could try storing some of the buffered data on disk,
> until the burst is over?
>
> Hard to imagine it would be reliable though
>
> --
> >>  Read the docs: http://akka.io/docs/
> >>  Check the FAQ: http://doc.akka.io/docs/akka/
> current/additional/faq.html
> >>  Search the archives: https://groups.google.com/
> group/akka-user
> ---
> You received this message because you are subscribed to the Google Groups
> "Akka User List" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to akka-user+unsubscr...@googlegroups.com.
> To post to this group, send email to akka-user@googlegroups.com.
> Visit this group at https://groups.google.com/group/akka-user.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.

[akka-user] Re: Akka | Work - Pull pattern running into problem !

2017-10-12 Thread Bwmat 
If, on average, your producers Don't outrun your producers, and only do so in 
limited bursts, you could try storing some of the buffered data on disk, until 
the burst is over?

Hard to imagine it would be reliable though

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.

Re: [akka-user] Re: Akka | Work - Pull pattern running into problem !

2017-10-12 Thread Justin du coeur 
There's basically no solution to the producer outrunning the consumers.
The point of Akka Streams is to signal upstream that things are fully
loaded, so that the producer knows to slow down; that makes the whole
system more robust, and puts the problem where it belongs, at the head end.

But if there is no way to slow down production, you *have* to build in
enough capacity to handle it, or sooner or later you're going to run out of
buffer space -- there's no magical solution to that...

On Thu, Oct 12, 2017 at 10:19 AM, Kunal Ghosh 
wrote:

> yes producer is fast and consumers can not keep up with it that is why i
> used work-pulling pattern.
> Does akka stream has solution for producer out running the consumer??? or
> is there any other option???
>
>
> On Thursday, October 12, 2017 at 7:30:21 PM UTC+5:30, Bwmat wrote:
>>
>> Sounds like your producers are out running your consumers?
>>
>> Have you looked at akka streams?
>>
> --
> >> Read the docs: http://akka.io/docs/
> >> Check the FAQ: http://doc.akka.io/docs/akka/
> current/additional/faq.html
> >> Search the archives: https://groups.google.com/group/akka-user
> ---
> You received this message because you are subscribed to the Google Groups
> "Akka User List" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to akka-user+unsubscr...@googlegroups.com.
> To post to this group, send email to akka-user@googlegroups.com.
> Visit this group at https://groups.google.com/group/akka-user.
> For more options, visit https://groups.google.com/d/optout.
>

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.

[akka-user] Re: Akka | Work - Pull pattern running into problem !

2017-10-12 Thread Kunal Ghosh 
yes producer is fast and consumers can not keep up with it that is why i 
used work-pulling pattern.
Does akka stream has solution for producer out running the consumer??? or 
is there any other option???

On Thursday, October 12, 2017 at 7:30:21 PM UTC+5:30, Bwmat wrote:
>
> Sounds like your producers are out running your consumers?
>
> Have you looked at akka streams? 
>

-- 
>>  Read the docs: http://akka.io/docs/
>>  Check the FAQ: 
>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>  Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to akka-user+unsubscr...@googlegroups.com.
To post to this group, send email to akka-user@googlegroups.com.
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.