Re: Ensuring that the message is persisted after acknowledgement

2021-08-24 Thread Peter Bukowinski
> >> >> >> -- Forwarded message - >> From: sunil chaudhari >> Date: Fri, Aug 20, 2021 at 8:00 AM >> Subject: Re: Ensuring that the message is persisted after acknowledgement >> To: >> Cc: Vairavanathan Emalayan >>

Re: Ensuring that the message is persisted after acknowledgement

2021-08-24 Thread Kunal Goyal
m: sunil chaudhari > Date: Fri, Aug 20, 2021 at 8:00 AM > Subject: Re: Ensuring that the message is persisted after acknowledgement > To: > Cc: Vairavanathan Emalayan > > > Hi Kunal, > This article may help you. > > https://betterprogramming.pub/kafka-acks-explaine

Re: Ensuring that the message is persisted after acknowledgement

2021-08-20 Thread Eric Azama
Rather than forcing writes to disk after each message, the usual method of ensuring durability is to configure the topic with a Replication Factor of 3, min.insync.replicas=2 and have producers configure acks=all. This ensures that the record has been replicated to at least 2 brokers before an ack

Re: Ensuring that the message is persisted after acknowledgement

2021-08-20 Thread sunil chaudhari
Hi Kunal, This article may help you. https://betterprogramming.pub/kafka-acks-explained-c0515b3b707e Cheers, Sunil. On Fri, 20 Aug 2021 at 8:11 PM, Kunal Goyal wrote: > Hello, > > We are exploring using Kafka for our application. Our requirement is that > once we write some messages to Kafka,

Ensuring that the message is persisted after acknowledgement

2021-08-20 Thread Kunal Goyal
Hello, We are exploring using Kafka for our application. Our requirement is that once we write some messages to Kafka, it should be guaranteed that the messages are persisted to disk. We found this article which sa