Sameer when you say that you need to "consume from and produce to a topic"
to me that seems like a good fit for Kafka Streams. Streaming your data
out of Kafka for a transform and back in has some fundamental costs and
operational challenges involved. Are the events in your stream stateless?
If it isn't stateless streams will ensure a consistent playback of events
if needed. Without knowing more about your pipeline it is hard to make
recommendations. Are you possibly using Kafka as a distributed queue?
On Tue, Mar 13, 2018 at 6:29 AM Sameer Rahmani <lxsame...@gmail.com> wrote:
> Hi folks,
> I need to consume from and produce to a topic. I have my own data pipeline
> to process the data.
> So I was wondering beside the stores and StreamDSL what does Kafka Streams
> brings to the table
> that might be useful to me ?