[jira] [Updated] (ATLAS-247) hive_column leve lineage
[ https://issues.apache.org/jira/browse/ATLAS-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vimal Sharma updated ATLAS-247: --- Attachment: ATLAS-247-v4.patch > hive_column leve lineage > > > Key: ATLAS-247 > URL: https://issues.apache.org/jira/browse/ATLAS-247 > Project: Atlas > Issue Type: New Feature >Affects Versions: 0.5-incubating >Reporter: Herman Yu >Assignee: Harish Butani > Fix For: 0.8-incubating > > Attachments: ATLAS-247-v4.patch, ATLAS-247.2.patch, ATLAS-247.patch > > > hive_column is not inherited from DataSet, thus can't be using hive_process > to track column level lineages > Is there specific reason that hive_column is not inheriting from Data Set? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ATLAS-247) hive_column leve lineage
[ https://issues.apache.org/jira/browse/ATLAS-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vimal Sharma updated ATLAS-247: --- Attachment: (was: ATLAS-247-v3.patch) > hive_column leve lineage > > > Key: ATLAS-247 > URL: https://issues.apache.org/jira/browse/ATLAS-247 > Project: Atlas > Issue Type: New Feature >Affects Versions: 0.5-incubating >Reporter: Herman Yu >Assignee: Harish Butani > Fix For: 0.8-incubating > > Attachments: ATLAS-247-v4.patch, ATLAS-247.2.patch, ATLAS-247.patch > > > hive_column is not inherited from DataSet, thus can't be using hive_process > to track column level lineages > Is there specific reason that hive_column is not inheriting from Data Set? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ATLAS-247) hive_column leve lineage
[ https://issues.apache.org/jira/browse/ATLAS-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vimal Sharma updated ATLAS-247: --- Attachment: ATLAS-247-v3.patch > hive_column leve lineage > > > Key: ATLAS-247 > URL: https://issues.apache.org/jira/browse/ATLAS-247 > Project: Atlas > Issue Type: New Feature >Affects Versions: 0.5-incubating >Reporter: Herman Yu >Assignee: Harish Butani > Attachments: ATLAS-247-v3.patch, ATLAS-247.2.patch, ATLAS-247.patch > > > hive_column is not inherited from DataSet, thus can't be using hive_process > to track column level lineages > Is there specific reason that hive_column is not inheriting from Data Set? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ATLAS-247) hive_column leve lineage
[ https://issues.apache.org/jira/browse/ATLAS-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vimal Sharma updated ATLAS-247: --- Attachment: (was: ATLAS-247.patch) > hive_column leve lineage > > > Key: ATLAS-247 > URL: https://issues.apache.org/jira/browse/ATLAS-247 > Project: Atlas > Issue Type: New Feature >Affects Versions: 0.5-incubating >Reporter: Herman Yu >Assignee: Harish Butani > Attachments: ATLAS-247.2.patch, ATLAS-247.patch > > > hive_column is not inherited from DataSet, thus can't be using hive_process > to track column level lineages > Is there specific reason that hive_column is not inheriting from Data Set? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ATLAS-247) hive_column leve lineage
[
https://issues.apache.org/jira/browse/ATLAS-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vimal Sharma updated ATLAS-247:
---
Attachment: ATLAS-247.patch
Made some changes to apply the patch.
The lineage information is not being set correctly in Hive.
{code}
public static Map
buildLineageMap(LineageInfo lInfo) {
Map m = new HashMap<>();
for(Map.Entry e :
lInfo.entrySet()) {
List l = new ArrayList<>();
ColumnName k = new ColumnName(e.getKey());
System.out.println(k.toString());
System.out.println("Col Lineage Key : " + e.getKey());
System.out.println("Col Lineage Value: " + e.getValue());
{code}
The dependency value e.getValue() is null. The source column in a column
lineage is not being populated in Hive SessionState. Seems like a bug with Hive
fix at https://issues.apache.org/jira/browse/HIVE-13112. Will follow up with
Hive team to identify the issue.
> hive_column leve lineage
>
>
> Key: ATLAS-247
> URL: https://issues.apache.org/jira/browse/ATLAS-247
> Project: Atlas
> Issue Type: New Feature
>Affects Versions: 0.5-incubating
>Reporter: Herman Yu
>Assignee: Harish Butani
> Attachments: ATLAS-247.2.patch, ATLAS-247.patch, ATLAS-247.patch
>
>
> hive_column is not inherited from DataSet, thus can't be using hive_process
> to track column level lineages
> Is there specific reason that hive_column is not inheriting from Data Set?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (ATLAS-247) hive_column leve lineage
[ https://issues.apache.org/jira/browse/ATLAS-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Butani updated ATLAS-247: Attachment: ATLAS-247.2.patch > hive_column leve lineage > > > Key: ATLAS-247 > URL: https://issues.apache.org/jira/browse/ATLAS-247 > Project: Atlas > Issue Type: New Feature >Affects Versions: 0.5-incubating >Reporter: Herman Yu >Assignee: Harish Butani > Attachments: ATLAS-247.2.patch, ATLAS-247.patch > > > hive_column is not inherited from DataSet, thus can't be using hive_process > to track column level lineages > Is there specific reason that hive_column is not inheriting from Data Set? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ATLAS-247) hive_column leve lineage
[ https://issues.apache.org/jira/browse/ATLAS-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shwetha G S updated ATLAS-247: -- Assignee: Harish Butani > hive_column leve lineage > > > Key: ATLAS-247 > URL: https://issues.apache.org/jira/browse/ATLAS-247 > Project: Atlas > Issue Type: New Feature >Affects Versions: 0.5-incubating >Reporter: Herman Yu >Assignee: Harish Butani > > hive_column is not inherited from DataSet, thus can't be using hive_process > to track column level lineages > Is there specific reason that hive_column is not inheriting from Data Set? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
