Gwen Shapira created KAFKA-4306:

             Summary: Connect workers won't shut down if brokers are not 
                 Key: KAFKA-4306
             Project: Kafka
          Issue Type: Bug
          Components: KafkaConnect
    Affects Versions:
            Reporter: Gwen Shapira
            Assignee: Ewen Cheslack-Postava

If brokers are not available and we try to shut down connect workers, sink 
connectors will be stuck in a loop retrying to commit offsets:

2016-10-17 09:39:14,907] INFO Marking the coordinator (id: 
2147483647 rack: null) dead for group connect-dump-kafka-config1 
[2016-10-17 09:39:14,907] ERROR Commit of 
WorkerSinkTask{id=dump-kafka-config1-0} offsets threw an unexpected exception:  
org.apache.kafka.clients.consumer.RetriableCommitFailedException: Offset commit 
failed with a retriable exception. You should retry committing offsets.
Caused by: org.apache.kafka.common.errors.GroupCoordinatorNotAvailableException

We should probably limit the number of retries before doing "unclean" shutdown.

This message was sent by Atlassian JIRA

Reply via email to