Dennis Jaheruddin created ATLAS-3929:
----------------------------------------
Summary: Kafka hook for Atlas
Key: ATLAS-3929
URL: https://issues.apache.org/jira/browse/ATLAS-3929
Project: Atlas
Issue Type: Improvement
Components: kafka-integration
Reporter: Dennis Jaheruddin
Currently we already have hooks for many engines (such as Spark, Nifi, Flink).
We also have a hook into the classical storage (HDFS). However, with streaming
becoming more and more dominant, we should also get a hook into the streaming
storage: Kafka.
Currently producers and consumers need to explicitly take atlas into account,
but for stronger governance and auditability, it should be possible to capture
every interaction with Kafka, regardless of how consumption or production is
done.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
