Hi Paul, Akka streams is still under development and marked as an experimental feature. Currently they can _not_ take advantage of the nodes in an akka cluster without writing all the code youserlf and connecting them over TCP. Doing this automatically is of course something that we have been thinking about, but it is still only on the drawing board.
Why do you feel that you are not ready for Spark? It would be very good feedback to know what to improve with akka streams. B/ On 4 November 2014 at 13:48:12, Paul Cleary ([email protected]) wrote: Working on a project where we need to do processing of high-volume data arriving via Kafka. We did a POC in Spark Streaming, but we are not yet ready for Spark. I was looking at using Storm, but the abstractions make me sad, at least compared to how you can pipeline in Spark. I am investigating using Akka Streams as an alternative to Storm, since we can support Akka + Play in production today. It feels like Akka Streams + Akka Clustering makes for a way to setup distributed pipelines to process large data flows. I was wondering if anyone can give me any pointers on how to setup Akka Streams so that it runs on a cluster (or if it is even possible). -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout. -- Björn Antonsson Typesafe – Reactive Apps on the JVM twitter: @bantonsson -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.
