[
https://issues.apache.org/jira/browse/KAFKA-18233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Harshit Pedamkar updated KAFKA-18233:
-------------------------------------
Summary: Mirrormaker 2 All Checkpoint Connector CPC tasks graceful shutdown
fails after which the consumer group offsets are replicated . (was:
Mirrormaker 2 All Worker tasks graceful shutdown fails after which the consumer
group offsets are replicated .)
> Mirrormaker 2 All Checkpoint Connector CPC tasks graceful shutdown fails
> after which the consumer group offsets are replicated .
> --------------------------------------------------------------------------------------------------------------------------------
>
> Key: KAFKA-18233
> URL: https://issues.apache.org/jira/browse/KAFKA-18233
> Project: Kafka
> Issue Type: Bug
> Components: mirrormaker
> Affects Versions: 3.5.1
> Reporter: Harshit Pedamkar
> Priority: Major
> Fix For: 3.5.1
>
> Attachments: connect-distributed.properties, connect.log,
> connect.log.2024-12-13-07, mm2-cpc-cust-repl-policy.json,
> mm2-hbc-cust-repl-policy.json, mm2-msc-cust-repl-policy.json
>
>
> Hi,
> It is noticed during load the Checkpoint Connectors graceful shutdown
> fails. After which the consumer group offsets are not replicates from source
> to target.
> We have a distributed mirrormaker2 container running. Logs are attached.
> Logs snippets:
> [2024-12-13 10:31:53,594] ERROR [mm2-cpc|worker] Connector 'mm2-cpc' failed
> to properly shut down, has become unresponsive, and may be consuming external
> resources. Correct the configuration for this connector or remove the
> connector. After fixing the connector, it may be necessary to restart this
> worker to release any consumed resources.
> (org.apache.kafka.connect.runtime.Worker:437)
> [2024-12-13 10:31:58,818] ERROR [mm2-cpc|worker] Connector 'mm2-cpc' failed
> to properly shut down, has become unresponsive, and may be consuming external
> resources. Correct the configuration for this connector or remove the
> connector. After fixing the connector, it may be necessary to restart this
> worker to release any consumed resources.
> (org.apache.kafka.connect.runtime.Worker:437)
> [2024-12-13 10:32:03,928] ERROR [mm2-cpc|worker] Connector 'mm2-cpc' failed
> to properly shut down, has become unresponsive, and may be consuming external
> resources. Correct the configuration for this connector or remove the
> connector. After fixing the connector, it may be necessary to restart this
> worker to release any consumed resources.
> (org.apache.kafka.connect.runtime.Worker:437)
> [2024-12-13 10:32:30,444] ERROR [mm2-cpc|task-30] Graceful stop of task
> mm2-cpc-30 failed. (org.apache.kafka.connect.runtime.Worker:1029)
> [2024-12-13 10:32:30,447] ERROR [mm2-cpc|task-27] Graceful stop of task
> mm2-cpc-27 failed. (org.apache.kafka.connect.runtime.Worker:1029)
> [2024-12-13 10:32:30,449] ERROR [mm2-cpc|task-33] Graceful stop of task
> mm2-cpc-33 failed. (org.apache.kafka.connect.runtime.Worker:1029)
> [2024-12-13 10:32:30,452] ERROR [mm2-cpc|task-36] Graceful stop of task
> mm2-cpc-36 failed. (org.apache.kafka.connect.runtime.Worker:1029)
> [2024-12-13 10:32:30,455] ERROR [mm2-cpc|task-42] Graceful stop of task
> mm2-cpc-42 failed. (org.apache.kafka.connect.runtime.Worker:1029)
> We have mirrormaker with the configuration. config files attached.
> Kakfa MSK runs with version 3.5.1
> Mirromaker2 we are using kafka_2.13-3.5.2
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
