Hi Chris, The current stream implementation (including IO) has not yet been optimized at all, our current focus is to settle on a set of features and user API that is satisfactory. We know a couple of bottlenecks that we intend to optimize later.
> - The outbound Flow uses a custom ActorPublisher at the head of the > Flow and the Flow looks like this: ActorPublisher -> groupWithin -> map (to > fold the multiple requests into one mega request) -> > produceTo(outboundConnection) > > You don't need to include those groupWithin -> map -- the stream TCP element will batch up all writes arriving during the time while a previous write finishes. -Endre > > - The Custom Publisher uses an internal Queue (a mutable > java.util.Queue for perf reasons) that it will add to if there is no demand > - The inbound Flow uses a custom ActorSubscriber at the tail of the > Flow and the Flow looks like this: Inbound Connection -> transform (for > memcached frame decoding) -> produceTo(Custom Subscriber) > > I know it's going to be tough to completely diagnose this issue without > seeing my code, and I'm willing to share it, but I wanted to reach out > first and see if this type of situation is a known issue or not. Is there > an issue trying to do a very high throughput single StreamTcp connection? > FWIW, on the custom publisher, I generally only ever see the demand at 4 > when I get a Request message so it seems as if the downstream stuff is > exhibiting significant back pressure on me. > > -- > >>>>>>>>>> Read the docs: http://akka.io/docs/ > >>>>>>>>>> Check the FAQ: > http://doc.akka.io/docs/akka/current/additional/faq.html > >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user > --- > You received this message because you are subscribed to the Google Groups > "Akka User List" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > Visit this group at http://groups.google.com/group/akka-user. > For more options, visit https://groups.google.com/d/optout. > -- Akka Team Typesafe - The software stack for applications that scale Blog: letitcrash.com Twitter: @akkateam -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.
