Fátima Galera created KAFKA-13338:
-------------------------------------
Summary: kafka upgrade 6.1.1 asking to change log.cleanup.policy
from delete to compact
Key: KAFKA-13338
URL: https://issues.apache.org/jira/browse/KAFKA-13338
Project: Kafka
Issue Type: Bug
Components: log
Reporter: Fátima Galera
Attachments: image003.png
Hi all,
During kafka upgrade from 5.3.1 to 6.1.1.1 we get below error starting
kafka-connector services
ERROR [Worker clientId=connect-1, groupId=connect-cluster] Uncaught exception
in herder work thread, exiting:
(org.apache.kafka.connect.runtime.distributed.DistributedHerder)
87738-org.apache.kafka.common.config.ConfigException: Topic 'connect-offsets'
supplied via the 'offset.storage.topic' property is required to have
'cleanup.policy=compact' to guarantee consistency and durability of source
connector offsets, but found the topic currently has 'cleanup.policy=delete'.
Continuing would likely result in eventually losing source connector offsets
and problems restarting this Connect cluster in the future. Change the
'offset.storage.topic' property in the Connect worker configurations to use a
topic with 'cleanup.policy=compact'.
After that error we added log.cleanup.policy=compact parameter on
/etc/kafka/server.properties and kafka-connector service started but a few days
later all the connectors are down with attached error.
Could you please let us know how we can resolved the issue?
Best regards and thanks
Fátima
NGA -Alight
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
