[ 
https://issues.apache.org/jira/browse/ATLAS-4773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17744609#comment-17744609
 ] 

Jagadesh Kiran N commented on ATLAS-4773:
-----------------------------------------

[~umeshpadashetty]

We are having a business case where we read data from Apache Kafka and write it 
to Apache Hadoop (HDFS) using Apache Spark Structured Streaming. Where the 
applications write its last processed Kafka messages minimum timestamp into 
Atlas Entity (Spark Process).

We have the Lineage in Atlas from Kafka (Dataset) to HDFS (Dataset) with Spark 
(Process).

_+*The requirement is:*+_

As we are storing the timestamps in Atlas Entity, is there any way that Atlas 
UI shows any delays based on the Atlas Entity's Timestamps???

> Can Apache Atlas Display get the delays in the lineage 
> -------------------------------------------------------
>
>                 Key: ATLAS-4773
>                 URL: https://issues.apache.org/jira/browse/ATLAS-4773
>             Project: Atlas
>          Issue Type: New Feature
>            Reporter: Jagadesh Kiran N
>            Priority: Major
>
> Atlas shows lineage , can we have a feature which display getting the delays 
> in the lineage. 
> Ex :Having a heat map to showcase the difference between lineage



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to