Re: Handling retriable exceptions during Connect source task start

2021-11-29 Thread Chris Egerton
Hi Gunnar, I think there's some risk of introducing this retry behavior if we end up invoking Connector::start or Task::start on the same object multiple times. Unexpected behavior may result, such as double-allocation of resources that are initialized in the start method and which are meant to be

Re: Handling retriable exceptions during Connect source task start

2021-11-28 Thread Luke Chen
Hi Gunnar and Sergei, I think it's good to have a retriable exception handling during task#start. > are retriable exceptions during start disallowed by design, and the task must not throw retriable exceptions during start, or it's just currently not supported by the Connect framework and I just ne

Re: Handling retriable exceptions during Connect source task start

2021-11-26 Thread Gunnar Morling
Hi all, We encountered a similar situation in Debezium again, where an exception during Task::start() would be desirable to be retried. Would anything speak against implementing retriable support for Task::start() in Kafka Connect? Would it require a KIP? Thanks, --Gunnar Am Mo., 9. Aug. 2021

Re: Handling retriable exceptions during Connect source task start

2021-08-09 Thread Gunnar Morling
Hi, To ask slightly differently: would there be interest in a pull request for implementing retries, in case RetriableException is thrown from the Task::start() method? Thanks, --Gunnar Am Do., 5. Aug. 2021 um 22:27 Uhr schrieb Sergei Morozov : > Hi, > > I'm trying to address an issue in Debe

Handling retriable exceptions during Connect source task start

2021-08-05 Thread Sergei Morozov
Hi, I'm trying to address an issue in Debezium (DBZ-3823 ) where a source connector task cannot recover from a retriable exception. The root cause is that the task interacts with the source database during SourceTask#start as but Kafka Connect doesn't ha

Fwd: Handling retriable exceptions during Connect source task start

2021-08-05 Thread Sergei Morozov
Hi, I'm trying to address an issue in Debezium (DBZ-3823 ) where a source connector task cannot recover from a retriable exception. The root cause is that the task interacts with the source database during SourceTask#start but Kafka Connect doesn't handl