[
https://issues.apache.org/jira/browse/ATLAS-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057421#comment-17057421
]
Vladislav Glinskiy commented on ATLAS-3661:
-------------------------------------------
cc [~kabhwan] [~sarath]
> Create 'spark_column_lineage' type and relationship definition to add support
> of column level lineage
> -----------------------------------------------------------------------------------------------------
>
> Key: ATLAS-3661
> URL: https://issues.apache.org/jira/browse/ATLAS-3661
> Project: Atlas
> Issue Type: Task
> Reporter: Vladislav Glinskiy
> Priority: Major
> Fix For: 2.1.0, 3.0.0
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> Create 'spark_column_lineage' type and corresponding
> 'spark_process_column_lineage' relationship definition to add support of
> column-level lineage.
> Column level lineage refers to lineage created between the input and output
> columns.
> For example:
> {code:java}
> hive > create table employee_ctas as select id from employee;{code}
> For the above query, lineage is created from 'employee' to 'employee_ctas',
> and also from 'employee.id' to 'employee_ctas.id'.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
