Re: Kafka streams usecase

2022-02-17 Thread Chad Preisler
It can be done with the consumer API. However, you're just going to end up re-implementing what is already there in the streams DSL. It will be far easier to use the Stream DSL join functionality to accomplish this. I've never tried to do it with a simple consumer. On Wed, Feb 16, 2022 at 6:45 PM

Re: Kafka streams usecase

2022-02-16 Thread pradeep s
Thanks Chad! if we want to consume from multiple topics and persist to a database , can i go with a consumer and lookup the record and update .Requirement is to consume from item topic and price topic and create a record in postgress . Both topic have item id in message which is the key in

Re: Kafka streams usecase

2022-01-13 Thread Chad Preisler
Yes Kafka streams can be used to do this. There are probably several ways to implement this. We did something like this in Java using a groupByKey() and reduce() functions. The three topics we wanted to combine into one topic had different schemas and different java class types. So to combine them

Kafka streams usecase

2022-01-11 Thread pradeep s
Hi , I have a requirement to stream item details to specific destinations . There are three different kafka streams , one for item info, second for item price and promotions and third for item availability . I want to join all these info and produce a single message containing item,price and