Hi Joe, There is a configuration section for the underlying IO stuff:
# The maximum number of bytes delivered by a `Received` message. Before # more data is read from the network the connection actor will try to # do other work. akka.io.tcp.max-received-message-size = unlimited (see http://doc.akka.io/docs/akka/2.3.7/general/configuration.html#akka-actor) You can set that to a fixed value (recommended for streams, so we might want to make it a default for stream IO) because otherwise a lot of things get slurped in one go. Since backpressure in streams is counted as elements, a few ByteStrings with a huge size can make your stuff slurped in completely (since one Received message can contain bytes as much as the network buffers can hold). Btw, a reproducer would help. -Endre On Wed, Nov 26, 2014 at 1:08 PM, Joe Edwards <[email protected]> wrote: > Thanks, sounds like I must be doing something wrong. This isn't a huge > priority right now, so I'll probably worry about it later. > > > The situation is that I have an app streaming a (potentially large) > request in from a client and forwards it on to another downstream > application. > > I made a test (runs in a separate process) that sends an infinitely large > chunked request (its source is an ActorPublisher that creates a new chunk > whenever it is requested), I also create a mock version of the downstream > application (using akka http) which requests a single chunk and then waits > indefinitely. > > I'd expect after a few seconds the app will stop streaming through data > (after the buffers fill up), and at the very least to notice some > difference between > > a) mock downstream cancels the entity stream immediately > a) mock downstream requests a single chunk then waits > b) mock downstream requests all chunks > > But they all stream in about 300-400MB before hitting my request timeout. > (Interestingly the size of the chunks doesn't seem to have much affect on > the amount streamed) > > -- > >>>>>>>>>> Read the docs: http://akka.io/docs/ > >>>>>>>>>> Check the FAQ: > http://doc.akka.io/docs/akka/current/additional/faq.html > >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user > --- > You received this message because you are subscribed to the Google Groups > "Akka User List" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > Visit this group at http://groups.google.com/group/akka-user. > For more options, visit https://groups.google.com/d/optout. > -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.
