[
https://issues.apache.org/jira/browse/APEXMALHAR-1925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Weise resolved APEXMALHAR-1925.
--------------------------------------
Resolution: Fixed
> The kafka offset manager may not store the offset of processed data in all
> scenarios
> ------------------------------------------------------------------------------------
>
> Key: APEXMALHAR-1925
> URL: https://issues.apache.org/jira/browse/APEXMALHAR-1925
> Project: Apache Apex Malhar
> Issue Type: Bug
> Reporter: Pramod Immaneni
> Assignee: Siyuan Hua
> Fix For: 3.3.0
>
>
> Because the operators further down in the DAG will lag the kafka input
> operator and stats are reported periodically to STRAM there can be scenarios
> where the offset reported to the offset manager in the STRAM is not yet
> processed completely by the DAG. This can lead to loss of data if the
> application restarts with that offset. The offset that should be reported
> should correspond to the data that is already processed in the DAG a.k.a
> offset corresponding to the committed window.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
