Rakesh Gupta created RANGER-5856:
------------------------------------
Summary: Fix TagSync Kafka offset commits for multi-partition
Atlas entity topics
Key: RANGER-5856
URL: https://issues.apache.org/jira/browse/RANGER-5856
Project: Ranger
Issue Type: Bug
Components: tagsync
Reporter: Rakesh Gupta
Assignee: Rakesh Gupta
Problem
TagSync lag grows on multi-partition Atlas entity Kafka topics. Some
partitions never get offsets committed; restarts replay large backlogs.
Cause
{{AtlasTagSource}} used one global offset and committed only the last message
in each batch, which breaks when the topic has multiple partitions.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
