[ https://issues.apache.org/jira/browse/KAFKA-15262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravindranath Kakarla updated KAFKA-15262: ----------------------------------------- Description: As per the MM2 [KIP-382|[https://cwiki.apache.org/confluence/display/KAFKA/KIP-382%3A+MirrorMaker+2.0]] the MirrorHeartbeatConnector should emit pings to heartbeat topic on the source cluster which then gets replicated to the target cluster. This can be used to demonstrate that MM2 is replicating the data. h2. _Internal Topics_ _MM2 emits a *heartbeat* *topic* in each source cluster, which is replicated to demonstrate connectivity through the connectors. Downstream consumers can use this topic to verify that a) the connector is running and b) the corresponding source cluster is available. Heartbeats will get propagated by source and sink connectors s.t. chains like backup.us-west.us-east.heartbeat are possible._ However, this is not happening right now. To contrary, the MirrorHeartbeatConnector is producing heartbeat pings to target cluster instead of source. This is not much useful as it won't help detect problems connecting to source cluster or with the data replication. Is my understanding of the MirrorHeartbeatConnector accurate? [Code Ref|https://github.com/apache/kafka/blob/ed44bcd71b3b9926c474033882eaa6c1cf35cfa4/connect/mirror/src/main/java/org/apache/kafka/connect/mirror/MirrorHeartbeatTask.java#L65] was: As per the MM2 [KIP-382|[https://cwiki.apache.org/confluence/display/KAFKA/KIP-382%3A+MirrorMaker+2.0],] the MirrorHeartbeatConnector should emit pings to heartbeat topic on the source cluster which then gets replicated to the target cluster. This can be used to demonstrate that MM2 is replicating the data. """ h2. Internal Topics MM2 emits a *heartbeat* *topic* in each source cluster, which is replicated to demonstrate connectivity through the connectors. Downstream consumers can use this topic to verify that a) the connector is running and b) the corresponding source cluster is available. Heartbeats will get propagated by source and sink connectors s.t. chains like backup.us-west.us-east.heartbeat are possible. """ However, this is not happening right now. To contrary, the MirrorHeartbeatConnector is producing heartbeat pings to target cluster instead of source. This is not much useful as it won't help detect problems connecting to source cluster or with the data replication. Is my understanding of the MirrorHeartbeatConnector accurate? [Code Ref|https://github.com/apache/kafka/blob/ed44bcd71b3b9926c474033882eaa6c1cf35cfa4/connect/mirror/src/main/java/org/apache/kafka/connect/mirror/MirrorHeartbeatTask.java#L65] > MirrorHeartbeatConnector is not working as documented > ----------------------------------------------------- > > Key: KAFKA-15262 > URL: https://issues.apache.org/jira/browse/KAFKA-15262 > Project: Kafka > Issue Type: Bug > Components: mirrormaker > Affects Versions: 2.8.0, 3.4.0, 3.5.0 > Reporter: Ravindranath Kakarla > Priority: Major > > As per the MM2 > [KIP-382|[https://cwiki.apache.org/confluence/display/KAFKA/KIP-382%3A+MirrorMaker+2.0]] > the MirrorHeartbeatConnector should emit pings to heartbeat topic on the > source cluster which then gets replicated to the target cluster. This can be > used to demonstrate that MM2 is replicating the data. > h2. _Internal Topics_ > _MM2 emits a *heartbeat* *topic* in each source cluster, which is replicated > to demonstrate connectivity through the connectors. Downstream consumers can > use this topic to verify that a) the connector is running and b) the > corresponding source cluster is available. Heartbeats will get propagated by > source and sink connectors s.t. chains like backup.us-west.us-east.heartbeat > are possible._ > > > However, this is not happening right now. To contrary, the > MirrorHeartbeatConnector is producing heartbeat pings to target cluster > instead of source. This is not much useful as it won't help detect problems > connecting to source cluster or with the data replication. > > Is my understanding of the MirrorHeartbeatConnector accurate? > [Code > Ref|https://github.com/apache/kafka/blob/ed44bcd71b3b9926c474033882eaa6c1cf35cfa4/connect/mirror/src/main/java/org/apache/kafka/connect/mirror/MirrorHeartbeatTask.java#L65] > -- This message was sent by Atlassian Jira (v8.20.10#820010)