Re: [akka-user] Fusing in akka-streams 2.0

2015-12-23 Thread Johannes Rudolph
On Tuesday, December 22, 2015 at 8:37:08 PM UTC+1, Adam Warski wrote: > > Having conflate only makes sense if there's some non-fused component out > there I guess, but you are correct of course that it can be fused with > things before/after it. > I thought a bit about this. Actually, it is not

Re: [akka-user] Fusing in akka-streams 2.0

2015-12-23 Thread Heiko Seeberger
Thanks for the heads up, Konrad! Heiko -- Heiko Seeberger Home: heikoseeberger.de Twitter: @hseeberger Public key: keybase.io/hseeberger > On 23 Dec 2015, at 09:38, Konrad Malawski > wrote: > > FYI, R

Re: [akka-user] Fusing in akka-streams 2.0

2015-12-23 Thread Roland Kuhn
Ah, damn, yes, I forgot the ping :-( > 23 dec 2015 kl. 09:38 skrev Konrad Malawski : > > FYI, Roland's docs update merged: https://github.com/akka/akka/pull/19268 > > I'll release 2.0.1 today as we found a bug in InputStreamPublisher. > > -- > Cheers,

Re: [akka-user] Fusing in akka-streams 2.0

2015-12-23 Thread Konrad Malawski
FYI, Roland's docs update merged: https://github.com/akka/akka/pull/19268 I'll release 2.0.1 today as we found a bug in InputStreamPublisher. --  Cheers, Konrad 'ktoso’ Malawski Akka @ Typesafe On 23 December 2015 at 09:14:58, Adam Warski (a...@warski.org) wrote: :-) But you are right, even th

Re: [akka-user] Fusing in akka-streams 2.0

2015-12-23 Thread Adam Warski
> :-) > > But you are right, even though “semantics” didn’t change—for some suitable > definition—user expectations may still be violated. I’ll write up some docs > right away, it would be great if you could review them—I’ll ping you > (@adamw, right?). > Sure :) @adamw is the right handle >

Re: [akka-user] Fusing in akka-streams 2.0

2015-12-22 Thread Roland Kuhn
splitWhen/splitAfter can only have one substream open at any given time and grouped does not create substreams but collections. Regards, Roland Sent from my iPhone > On 22 Dec 2015, at 23:47, matheuslima...@gmail.com wrote: > > * Why splitAfter/splitWhen/grouped don't have maxSubstreams para

Re: [akka-user] Fusing in akka-streams 2.0

2015-12-22 Thread matheuslimaufc
* Why splitAfter/splitWhen/grouped don't have maxSubstreams parameter by the same reason (bound resource consumption)? On Tuesday, December 22, 2015 at 8:44:14 PM UTC-2, matheus...@gmail.com wrote: > > Why splitAfter/splitWhen/grouped also haven't maxSubstreams parameter by > the same reason (b

Re: [akka-user] Fusing in akka-streams 2.0

2015-12-22 Thread matheuslimaufc
Why splitAfter/splitWhen/grouped also haven't maxSubstreams parameter by the same reason (bound resource consumption)? On Tuesday, December 22, 2015 at 7:18:25 PM UTC-2, rkuhn wrote: > > We will make it fusable in the same fashion as > splitWhen/splitAfter/prefixAndTail are fusable. One minor co

Re: [akka-user] Fusing in akka-streams 2.0

2015-12-22 Thread Roland Kuhn
We will make it fusable in the same fashion as splitWhen/splitAfter/prefixAndTail are fusable. One minor correction: the number of substreams is no longer unbounded, the API demands that you specify a limit beyond which the groupBy logic will fail the stream. This is necessary in order to place

Re: [akka-user] Fusing in akka-streams 2.0

2015-12-22 Thread Roland Kuhn
Hi Adam, > 22 dec 2015 kl. 20:37 skrev Adam Warski : > > >> Now, with auto-fusing that changes. By default, if there's a split, the >> branches won't be executed in parallel. I think that's quite a big >> semantical change. > > This is a bit of an overstatement: the semantics of the stream pr

Re: [akka-user] Fusing in akka-streams 2.0

2015-12-22 Thread Adam Warski
> > > Now, with auto-fusing that changes. By default, if there's a split, the > branches won't be executed in parallel. I think that's quite a big > semantical change. > > > This is a bit of an overstatement: the semantics of the stream processing > do not change, the same rules apply to how el

Re: [akka-user] Fusing in akka-streams 2.0

2015-12-22 Thread Roland Kuhn
Hi Adam, thanks for trying out the new release (and for the blog update!) and also for your feedback; comments inline. > 22 dec 2015 kl. 16:41 skrev Adam Warski : > > Hello, > > I think that the new fusing support in akka-streams may have more > consequences than I initially suspected. It qui

Re: [akka-user] Fusing in akka-streams 2.0

2015-12-22 Thread Adam Warski
On Tuesday, December 22, 2015 at 5:17:09 PM UTC+1, Konrad Malawski wrote: > > > I'll leave the semantics questions to Roland or Endre to tackle (in > general it should not change semantics), but a few quick ones: > > > 2. how to insert async boundaries in linear pipelines? E.g.: > > Source(List(

Re: [akka-user] Fusing in akka-streams 2.0

2015-12-22 Thread Konrad Malawski
I'll leave the semantics questions to Roland or Endre to tackle (in general it should not change semantics), but a few quick ones: 2. how to insert async boundaries in linear pipelines? E.g.: Source(List(1, 2, 3))       .map(_ + 1)            .addAttributes(Attributes.asyncBoundary)       .map

[akka-user] Fusing in akka-streams 2.0

2015-12-22 Thread Adam Warski
Hello, I think that the new fusing support in akka-streams may have more consequences than I initially suspected. It quite drastically changes how concurrency is handled in akka-streams. So far the model was quite clear: every stage gets materialised into an actor. If there's a split/broadcast