Doing something wrong

Hi, I created a simple Spring Boot Application with Kafka and added a dependency from Kafka Streams. The application can send and receive messages and works fine. In the same app, I want to use Kafka Streams to calculate statistic about the topic. I wrote the following code from the word count

Re: Event Sourcing question

Ryanne, Thank you for the advice. It's exactly what we have now. Different topics for different processing steps. However, I would like to make extensible architecture with multiple processing steps. We will introduce other transformers later on. I was thinking that if all of them will send

Re: Event Sourcing question

If ordering of these events is important, then putting them in the same topic is not only desired, it's necessary. See https://www.confluent.io/blog/put-several-event-types-kafka-topic/. However, think hard about whether ordering is actually important in your use case or not, as things are

[VOTE] 2.2.1 RC0

Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 2.2.1, which includes many bug fixes for Apache Kafka 2.2. Release notes for the 2.2.1 release: https://home.apache.org/~vahid/kafka-2.2.1-rc0/RELEASE_NOTES.html *** Please download,

Re: Event Sourcing question

Pavel, one thing I'd recommend: don't jam multiple event types into a single topic. You are better served with multiple topics, each with a single schema and event type. In your case, you might have a received topic and a transformed topic, with an app consuming received and producing transformed.

Re: [Streams] TimeWindows ignores gracePeriodMs in windowsFor(timestamp)

Hi John, Thank you for your reply. Indeed, your explanation makes sense to me. Thank you again for taking the time to reply. Regards, Jose On Tue, 30 Apr 2019 at 22:22, John Roesler wrote: > Hi Ashok, > > I think some people may be able to give you advice, but please start a new > thread

Event Sourcing question

I have an architectural question. I am planning to create a data transformation pipeline for document transformation. Each component will send processing events to the Kafka 'events' topic. It will have the following steps: 1) Upload data to the repository (S3 or other storage). Get public URL

Re: Using processor API via DSL

Hi Bruno, no worries. No that was an old problem, the latest code is on the gist from the last email. Anyway I've pushed the master branch with the same code, I'm not sure I've done the right thing with the jars but the code should be there. The gist

Re: Using processor API via DSL

Hi Alessandro, Apologies for the late reply. I tried the code from your repository under https://github.com/alex88/kafka-test/tree/master and I run into a `ClassCastException`. I think this is a bug that is described here https://issues.apache.org/jira/browse/KAFKA-8317 . Should I have tried

Re: Topic Creation two different config(s)

You can use AdminClient.createTopics with the necessary configuration. On Wed, May 8, 2019 at 12:08 PM SenthilKumar K wrote: > Hello Experts , We have a requirement to create topic dynamically with two > different config(s). Is this possible in Kafka ? > > Kafka Version : 2.2.0 > > Topics with

Topic Creation two different config(s)

Hello Experts , We have a requirement to create topic dynamically with two different config(s). Is this possible in Kafka ? Kafka Version : 2.2.0 Topics with different settings: #1 - Set retention as 24 hours for free tier customers # 2 - Set retention as 72 hours for paid customers Note :