I'm working on building an application that uses Akka Streams to process data..
*tl;dr* When i use .async() on a flow i notice the element to the left of it (normally source in my case) is pulled numerous time, i'd like to prevent this behaviour and only pull when the stream itself asks for it to pull. *Details* One of the element i'm working on is the idea of 'limiting' the number of concurrent 'data chunks' in the stream. In this case we're processing satellite data and each flow in the stream is processor that manipulates the data. The input data is fairly large, but each processor then adds additional data to it, i've so far made the stream iterator on one record at a time but i would like the ability to only allow say 20 rows of data in the stream at any one time. I've written two flows the use an actor to keep track on the number of rows in the stream, when the first actor gets an onPush it asks the actor if there is room for it? if so it pushes it, if not it waits for there to be room. The second flow sits at the end and notifies the actor when a row leaves the stream (well between the two flows). However i hit an issue where without using async on the first flow the stream locks up (unsurprisingly), but when i add async to that flow i notice that it looks like it starts buffering. My source's pull is called multiple times right at the start and i see other 'strange' behaviour because of this. Even if for instance i use .buffer to set the buffer to 1 (can't be 0) i still get issues. Any suggestions on why i see this or if i've gone around this whole limiting idea the completely wrong way :) Also i'm doing this in Java.. -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.
