mirroring Kafka while preserving the order

Is it possible to configure mirror maker using message handler to preserve the order of messages in each topic partition. In the particular use case we're looking at both source and destination topics have same number of partitions. Sunil

Tuning up mirror maker for high thruput

message handler still try to process the other topics but let it pass thru. Thanks, Sunil Parmar

Open file descriptors on a broker

https://issues.apache.org/jira/browse/KAFKA-3619 which appears to found and fixed in 0.10. Can someone confirm if this is not an issue in 0.9. Thanks, Sunil Parmar

mirror maker producer thread dies with error

this happens on the perticular day of the week but I coudln't locate any weekly scheduler in any configuration. Any pointers will be helpful Thanks, Sunil Parmar

Enable Kafka Authentication on 0.9

something like LDAP. Thanks, Sunil Parmar

monitor consumer offset lag script/code

We're using 0.9 ( CDH ) and consumer offsets are stored within Kafka. What is the preferred way to get consumer offset from code or script for monitoring ? Is there any sample code/ script to do so ? Thanks, Sunil Parmar

Re: monitor consumer offset lag script/code

Thanks Kaufman .. Shubhash, We're using burrow but it has two issues. 1) The lag reported from command line tools and burrow is different often by big margin. 2) When consumer goes down it stops reporting the difference and shows constant value. Sunil Parmar On Tue, Jan 30, 2018 at 6:

Causes of partition leader re election

lp us debug this partition leader re-election. Sunil Parmar

rolling upgrade from 0.9 to 0.11

of performance impact in production when done on scale. thoughts ? Sunil Parmar

Preserve offset in Mirror Maker

We're using mirror maker to mirror data from one data center to another data center ( 1 to 1 ). We noticed that by default the mirror maker by default start from latest offset. How to change mirror maker producer config to start from last check pointed offset in case of crash without losing dat