Viktor Somogyi-Vass reassigned ATLAS-3929:

    Assignee: Viktor Somogyi-Vass

> Kafka hook for Atlas to capture production/consumption
> ------------------------------------------------------
>                 Key: ATLAS-3929
>                 URL: https://issues.apache.org/jira/browse/ATLAS-3929
>             Project: Atlas
>          Issue Type: Improvement
>          Components: kafka-integration
>            Reporter: Dennis Jaheruddin
>            Assignee: Viktor Somogyi-Vass
>            Priority: Major
> Currently we already have hooks for many engines (such as Spark, Nifi, 
> Flink). We also have a hook into the classical storage (HDFS). However, with 
> streaming becoming more and more dominant, we should also get a hook into the 
> streaming storage: Kafka.
> Currently producers and consumers need to explicitly take atlas into account, 
> but for stronger governance and auditability, it should be possible to 
> capture every interaction with Kafka, regardless of how consumption or 
> production is done.

This message was sent by Atlassian Jira

Reply via email to