[
https://issues.apache.org/jira/browse/KAFKA-9076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17268908#comment-17268908
]
Charlie Johnston commented on KAFKA-9076:
-----------------------------------------
Was this feature intended to only be one-directional or is this just a subset
of the intended functionality? Using this with MM2 configuration and two active
sites, I find that the site prefixed topics are not being included in any
offset mirroring only the non-site prefixed (original) topics are being
mirrored. Is it not common with MM2 use to have a scenario with consumers
consuming from multiple topics (topic per site) to consume all sites? Apologies
if there is any confusion or missing setting on my end, we dug through the code
a bit and couldn't find any signs to suggest site prefixed topics are also
mirrored. Thanks!
> MirrorMaker 2.0 automated consumer offset sync
> ----------------------------------------------
>
> Key: KAFKA-9076
> URL: https://issues.apache.org/jira/browse/KAFKA-9076
> Project: Kafka
> Issue Type: Improvement
> Components: mirrormaker
> Affects Versions: 2.4.0
> Reporter: Ning Zhang
> Assignee: Ning Zhang
> Priority: Major
> Labels: mirrormaker, pull-request-available
> Fix For: 2.7.0
>
>
> To calculate the translated consumer offset in the target cluster, currently
> `Mirror-client` provides a function called "remoteConsumerOffsets()" that is
> used by "RemoteClusterUtils" for one-time purpose.
> In order to make the consumer and stream applications migrate from source to
> target cluster transparently and conveniently, e.g. in event of source
> cluster failure, a background job is proposed to periodically sync the
> consumer offsets from the source to target cluster, so that when the consumer
> and stream applications switch to the target cluster, it will resume to
> consume from where it left off at source cluster.
> KIP:
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-545%3A+support+automated+consumer+offset+sync+across+clusters+in+MM+2.0
> [https://github.com/apache/kafka/pull/7577]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
