Vladislav Glinskiy created ATLAS-3661:
-----------------------------------------
Summary: Create 'spark_column_lineage' type and relationship
definition to add support of column level lineage
Key: ATLAS-3661
URL: https://issues.apache.org/jira/browse/ATLAS-3661
Project: Atlas
Issue Type: Task
Reporter: Vladislav Glinskiy
Fix For: 2.1.0, 3.0.0
Create 'spark_column_lineage' type and corresponding
'spark_process_column_lineage' relationship definition to add support of
column-level lineage.
Column level lineage refers to lineage created between the input and output
columns.
For example:
{code:java}
hive > create table employee_ctas as select id from employee;{code}
For the above query, lineage is created from 'employee' to 'employee_ctas',
and also from 'employee.id' to 'employee_ctas.id'.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
