[
https://issues.apache.org/jira/browse/ATLAS-1111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shwetha G S updated ATLAS-1111:
-------------------------------
Attachment: ATLAS-1111.patch
1. Stopping services before graph shutdown
2. Adding retries in hook consumer
3. Logging only failed messages to another file
> Data loss is observed when atlas is restarted while hive_table metadata
> ingestion into kafka topic is in-progress
> -----------------------------------------------------------------------------------------------------------------
>
> Key: ATLAS-1111
> URL: https://issues.apache.org/jira/browse/ATLAS-1111
> Project: Atlas
> Issue Type: Bug
> Reporter: Sharmadha Sainath
> Priority: Critical
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1111.patch
>
>
> During atlas stop, the graph is shutdown first and then the services like
> NotificationHookConsumer is shutdown. After graph is shutdown and before
> NotificationHookConsumer is shutdown, the message handling fails as the graph
> is down, but the NotificationHookConsumer commits the message(updating the
> offset). So, the messages during this time are lost
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
