[
https://issues.apache.org/jira/browse/ATLAS-3929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dennis Jaheruddin updated ATLAS-3929:
-------------------------------------
Summary: Kafka hook for Atlas to capture production/consumption (was:
Kafka hook for Atlas)
> Kafka hook for Atlas to capture production/consumption
> ------------------------------------------------------
>
> Key: ATLAS-3929
> URL: https://issues.apache.org/jira/browse/ATLAS-3929
> Project: Atlas
> Issue Type: Improvement
> Components: kafka-integration
> Reporter: Dennis Jaheruddin
> Priority: Major
>
> Currently we already have hooks for many engines (such as Spark, Nifi,
> Flink). We also have a hook into the classical storage (HDFS). However, with
> streaming becoming more and more dominant, we should also get a hook into the
> streaming storage: Kafka.
> Currently producers and consumers need to explicitly take atlas into account,
> but for stronger governance and auditability, it should be possible to
> capture every interaction with Kafka, regardless of how consumption or
> production is done.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
