Re: enable.auto.commit=true and checkpointing turned on

2021-12-06 Thread Vishal Santoshi
perfect. Thanks. That is what I imagined. On Mon, Dec 6, 2021 at 2:04 AM Hang Ruan wrote: > Hi, > > 1. Yes, the kafka source will use the Kafka committed offset for the group > id to start the job. > > 2. No, the auto.offset.reset >

Re: enable.auto.commit=true and checkpointing turned on

2021-12-05 Thread Hang Ruan
Hi, 1. Yes, the kafka source will use the Kafka committed offset for the group id to start the job. 2. No, the auto.offset.reset is from Kafka consumer config, which defines what to do when there is no initial offset in

enable.auto.commit=true and checkpointing turned on

2021-12-03 Thread Vishal Santoshi
Hello folks, 2 questions 1. If we have enabled enable.auto.commit and enabled checkpointing and we restart a flink application ( without checkpoint or savepoint ) , would the kafka consumer start consuming from the last offset committed to kafka. 2. What if in the above scenario, we have