So, if I understand correctly, are you saying, the incoming data from 3rd party service is put into a Kafka topic, akka streams will use the Kafka topic as the source, and Kafka will ensure only one stream will consume the data at any given time?
On Saturday, November 28, 2015 at 9:46:23 AM UTC-8, [email protected] wrote: > > You can use kafka to send messages do multiple akka stream consumers. > Kafka is a pub subs infrastructure. It can balance load between multiple > consumers and has high performance. > http://kafka.apache.org/ > > Basically you define a topic where messages are insert into and consumed. > One topic has N partitions and the partition are shared between multple > consumers. > > On Saturday, November 28, 2015 at 1:54:00 AM UTC-2, Patrick Li wrote: >> >> Hi, >> >> I have an application (based on Play 2/akka) using akka-stream to stream >> data from one service (e.g. Twitter) to another. The application is >> stateless, so I plan to have two instances of the app running with a load >> balancer in the front to scale it out as well as have redundancy. >> Everything works well except in this case, two streams are created, 1 per >> app, and this duplicates the data being sent to the sink. >> >> I read the documentation as well as some threads here, that akka-stream >> at the moment does not support remote actors, so I cannot leverage >> akka-cluster's singleton actor. Are there any workaround or other approach >> I can have two apps running but only 1 stream running (or 2 streams but >> only 1 active)? Preferably, if one stream or the app dies, the other app >> can start a new stream and keep going. >> >> Thanks >> Patrick >> > -- >>>>>>>>>> Read the docs: http://akka.io/docs/ >>>>>>>>>> Check the FAQ: >>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html >>>>>>>>>> Search the archives: https://groups.google.com/group/akka-user --- You received this message because you are subscribed to the Google Groups "Akka User List" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/akka-user. For more options, visit https://groups.google.com/d/optout.
