Endre, thank you for responding. Following is what the author of Rediscala has to say.
*"Yes i noticed it during my tests, at some point the scale is exponential (bad).* *I suspected the thread scheduler to be the limitation.Or the way Future.sequence works.* *If you can isolate a test that scale linearly up to 1M of futures, I would be interested to see it. By replacing akka-io with another java.nio library (xnio) I was able to pass the 1M req (at the speed of around 500k req/s)" * https://github.com/etaty/rediscala/issues/67 If replacing akka-io with java.nio resolves this then either akka-io is not used correctly in Rediscala OR it is a fundamental limitation of akka-io. My other responses inline. On Saturday, December 20, 2014 6:35:22 AM UTC-5, Akka Team wrote: > > Hi, > > My personal guess is that since you don't obey any backpressure when you > start flooding the redis client with requests you end up with a lot of > queued messages and probably high GC pressure. You can easily test this by > looking at the memory profile of your test. > > Yes, the memory pressure is indeed high. The young generation (Edge) space fills up very quickly and then a minor GC is kicked off. Can I use akka-streams to resolve and add backpressure here? Any pointers here will be greatly appreciated. > > > On Sat, Dec 20, 2014 at 6:55 AM, Soumya Simanta <[email protected] > <javascript:>> wrote: > >> val res: Future[List[Boolean]] = Future.sequence(result.toList) val end = >> System.currentTimeMillis() val diff = (end - start) println(s"for msgSize >> $msgSize and numOfRuns [$numberRuns] time is $diff ms ") >> akkaSystem.shutdown() >> >> } >> > What does the above code intend to measure? Didn't you want to actually > wait on the "res" future? > > Yes, you are correct again. I should be waiting on res in order to get an estimate of overall latency. -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.
