Sridhar created ATLAS-3413:
------------------------------
Summary: HMS should create a dummy process linking HDFS path to
Hive table for external table lineage.
Key: ATLAS-3413
URL: https://issues.apache.org/jira/browse/ATLAS-3413
Project: Atlas
Issue Type: Improvement
Reporter: Sridhar
Assignee: Sridhar
HMS should create a dummy process linking HDFS path to Hive table for external
table lineage.
Currently, HS2 creates the linkage from file path to table. But, when an
external table is created from impala or spark, there is no lineage is getting
created from hdfs_path to table. As a fix, we would like HMS hook to create the
lineage for external tables.
Where ever possible, HMS hook should create the process with the same qualified
name as that of what gets created as part of individual service specific hook.
For now, HMS hook will resolve the HS2 service processes only. For impala and
Spark, the process will be created a dummy hive process as a place holder to
avoid missing lineages.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
