Re: Preserve offset in Mirror Maker

[Gwen Shapira]

MirrorMaker actually doesn't have a default - it uses what you
configured in the consumer.properties file you use.

Either:
auto.offset.reset = latest (biggest in old versions)
or
auto.offset.reset = earliest (smallest in old versions)

So you can choose whether when MirrorMaker first comes up, if it
starts from beginning or end.

Note that this is just for first start. Any other restart after, it
should use the checkpoints like normal consumers and not lose data
(especially in 0.9.0 and above).

Gwen

On Wed, Aug 3, 2016 at 2:15 PM, Sunil Parmar  wrote:
> We're using mirror maker to mirror data from one data center to another data 
> center ( 1 to 1 ). We noticed that by default the mirror maker by default 
> start from latest offset.  How to change mirror maker producer config to 
> start from last check pointed offset in case of crash without losing data ?
>
> -Sunil
>

Preserve offset in Mirror Maker

[Sunil Parmar]

We're using mirror maker to mirror data from one data center to another data 
center ( 1 to 1 ). We noticed that by default the mirror maker by default start 
from latest offset.  How to change mirror maker producer config to start from 
last check pointed offset in case of crash without losing data ?

-Sunil