Re: Possible Bug: kafka-reassign-partitions causing the data retention time to be reset

2022-05-02 Thread Fares Oueslati
afterwards. Thanks a lot! Fares On Fri, Apr 29, 2022 at 3:24 AM Fares Oueslati wrote: > Thanks for your help! > > I'm not sure how that would help me though. I'm not actually trying to > decommission a Kafka broker. > I would like to move all the data from one disk (log.dir) to a

Re: Possible Bug: kafka-reassign-partitions causing the data retention time to be reset

2022-04-28 Thread Fares Oueslati
> replay the case . > > On Thu, Apr 28, 2022 at 10:33 PM Fares Oueslati > wrote: > >> Hello, >> >> I'm not sure how to report this properly but I didn't get any answer in >> the >> user mailing list. >> >> In order to remove a disk in a JBOD

Possible Bug: kafka-reassign-partitions causing the data retention time to be reset

2022-04-28 Thread Fares Oueslati
, is it possible to create a JIRA to track and eventually fix this? The only option I see to fix it is to keep the modification date before moving the data and applying it manually afterwards for every segment file, touching those files manually doesn't seem very safe imho. Thanks Fares Oueslati

Topics naming convention

2020-04-06 Thread Fares Oueslati
Hello, I'm here to get some advice regarding Kafka topics naming. If I name my topic "users" and I publish Avro events with a schema registry using a given compatibility mode. One day, due to business reasons, I have to break my schema, what would you do? add a new topic (let's call it

Re: Question about log flusher real frequency

2020-03-09 Thread Fares Oueslati
*when* your data is on the disk? > > [1] https://www.kernel.org/doc/Documentation/sysctl/vm.txt > > Le lun. 9 mars 2020 à 15:58, Fares Oueslati a > écrit : > > > > Hello, > > > > By default, both log.flush.interval.ms and log.flush.interval.messages > are &

Question about log flusher real frequency

2020-03-09 Thread Fares Oueslati
Hello, By default, both log.flush.interval.ms and log.flush.interval.messages are set to Long.MAX_VALUE. As I understand, it makes Kafka flush log to disk (fsync) only depends on file system. Is there any simple way to monitor that frequency ? Is there a rule of thumb to estimate that value

Re: Mistake in official documentation ?

2020-02-06 Thread Fares Oueslati
g list will allow it to be attached. > > It could very well be a mistake. highlight it and send it to > dev@kafka.apache.org and if it is, we'll make a ticket and address it. > > On Thu, Feb 6, 2020 at 10:53 AM Fares Oueslati > wrote: > > > Hello, > > > > Wh

Mistake in official documentation ?

2020-02-06 Thread Fares Oueslati
Hello, While going through the official docs https://kafka.apache.org/documentation/#messageformat If I'm not wrong, I believe there is a mismatch between description of a segment and the diagram illustrating the concept. I pointed out the issue in the attached screenshot. Didn't really know