Hi Guys,

How can I do scatter-gather with Akka streams. Basically:

1. I’m reading messages from Kafka using akka-stream-kafka
2. Then I group the messages using “groupedWithin”
3. Then I need to split the resulting batch into multiple groups (1 per logical 
shard)
4. I want to be able to process the batches from step 3 concurrently
5. Once all the batches have been processed, I need to commit the last offset 
to Kafka

I know I can do #3 using groupBy, but then I lose the ability to commit the 
last offset to Kafka. Is there an equivalence to Future.sequence or something 
similar in Akka Stream?

Thanks,

Drew

-- 
>>>>>>>>>>      Read the docs: http://akka.io/docs/
>>>>>>>>>>      Check the FAQ: 
>>>>>>>>>> http://doc.akka.io/docs/akka/current/additional/faq.html
>>>>>>>>>>      Search the archives: https://groups.google.com/group/akka-user
--- 
You received this message because you are subscribed to the Google Groups "Akka 
User List" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/akka-user.
For more options, visit https://groups.google.com/d/optout.

Reply via email to