[
https://issues.apache.org/jira/browse/RANGER-5856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rakesh Gupta resolved RANGER-5856.
----------------------------------
Fix Version/s: 3.0.0
2.10
Resolution: Fixed
> Fix TagSync Kafka offset commits for multi-partition Atlas entity topics
> ------------------------------------------------------------------------
>
> Key: RANGER-5856
> URL: https://issues.apache.org/jira/browse/RANGER-5856
> Project: Ranger
> Issue Type: Bug
> Components: tagsync
> Reporter: Rakesh Gupta
> Assignee: Rakesh Gupta
> Priority: Major
> Fix For: 3.0.0, 2.10
>
> Time Spent: 50m
> Remaining Estimate: 0h
>
> Problem
> TagSync lag grows on multi-partition Atlas entity Kafka topics. Some
> partitions never get offsets committed; restarts replay large backlogs.
> Cause
> {{AtlasTagSource}} used one global offset and committed only the last
> message in each batch, which breaks when the topic has multiple partitions.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
