[
https://issues.apache.org/jira/browse/ATLAS-801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hemanth Yamijala updated ATLAS-801:
-----------------------------------
Description: All integration hooks in Atlas write messages to Kafka which
are picked up by the Atlas server. If communication to Kafka breaks, then this
results in loss of metadata messages. This can be mitigated to some extent
using multiple replicas for Kafka topics (see ATLAS-515). This JIRA is to see
if we can make this even more robust and have some form of store and forward
mechanism for increased fault tolerance. (was: All integration hooks in Atlas
write messages to Kafka which are picked up by the Atlas server. This can be
mitigated to some extent using multiple replicas for Kafka topics (see
ATLAS-515). This JIRA is to see if we can make this even more robust and have
some form of store and forward mechanism for increased fault tolerance.)
> Atlas hooks would lose messages if Kafka is down for extended period of time
> ----------------------------------------------------------------------------
>
> Key: ATLAS-801
> URL: https://issues.apache.org/jira/browse/ATLAS-801
> Project: Atlas
> Issue Type: Improvement
> Reporter: Hemanth Yamijala
> Assignee: Hemanth Yamijala
>
> All integration hooks in Atlas write messages to Kafka which are picked up by
> the Atlas server. If communication to Kafka breaks, then this results in loss
> of metadata messages. This can be mitigated to some extent using multiple
> replicas for Kafka topics (see ATLAS-515). This JIRA is to see if we can make
> this even more robust and have some form of store and forward mechanism for
> increased fault tolerance.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
