[
https://issues.apache.org/jira/browse/RANGER-5856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18138689#comment-18138689
]
Rakesh Gupta commented on RANGER-5856:
--------------------------------------
*Merged into apache master* :
https://github.com/apache/ranger/commit/3884b9b669f55ce6365110e88505894d454e0d28
*Merged into ranger-2.10*:
https://github.com/apache/ranger/commit/cac1dc732f333ceb7435985089fd0a0b162035dd
> Fix TagSync Kafka offset commits for multi-partition Atlas entity topics
> ------------------------------------------------------------------------
>
> Key: RANGER-5856
> URL: https://issues.apache.org/jira/browse/RANGER-5856
> Project: Ranger
> Issue Type: Bug
> Components: tagsync
> Reporter: Rakesh Gupta
> Assignee: Rakesh Gupta
> Priority: Major
> Time Spent: 50m
> Remaining Estimate: 0h
>
> Problem
> TagSync lag grows on multi-partition Atlas entity Kafka topics. Some
> partitions never get offsets committed; restarts replay large backlogs.
> Cause
> {{AtlasTagSource}} used one global offset and committed only the last
> message in each batch, which breaks when the topic has multiple partitions.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
