Re: Are Kafka and Kafka Streams right tools for my case?

Hello, I have observed several use cases similar to yours that are using Kafka / Kafka Streams in production. That being said, your concerns are valid: * Big messages: 5MB is indeed large, but not extremely big for Kafka. If it is a single message of hundreds of MBs or over a GB then it's a bit d

Are Kafka and Kafka Streams right tools for my case?

I'm new to Kafka and will be grateful for any advice We are updating a legacy application together with moving it from IBM MQ to something different. Application currently does the following: * Reads batch XML messages (up to 5 MB) * Parses it to something meaningful * Processes data paral

Re: does Kafka exactly-once guarantee also apply to kafka state stores?

Is there also a way to avoid duplicates if the application consumer from kafka topic and writes the events to database? e.g. in case the application restarts while processing a batch read from topic and few events already written to database, when application restarts, those events are again consum

Re: [EXTERNAL] SSL error while doing curl on kafka

@Sachit SEC_ERROR_UNTRUSTED_ISSUER --> problem with SSL certificate, unstrusted So you would need CA certificate which issued into truststore used by curl for calls to trust. Depending on OS could be in different location. But not sure what you trying to do, if you really interested on Kafka c

SSL error while doing curl on kafka

Hello All, I am doing curl o : of kafka. It is throwing below error post applying SSL. Can you please check? NSS error -8172 (SEC_ERROR_UNTRUSTED_ISSUER) * Peer's certificate issuer has been marked as not trusted by the user. Kind Regards, Sachit Murarka