[jira] [Updated] (ATLAS-247) hive_column leve lineage
[ https://issues.apache.org/jira/browse/ATLAS-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vimal Sharma updated ATLAS-247: --- Attachment: ATLAS-247-v4.patch > hive_column leve lineage > > > Key: ATLAS-247 > URL: https://issues.apache.org/jira/browse/ATLAS-247 > Project: Atlas > Issue Type: New Feature >Affects Versions: 0.5-incubating >Reporter: Herman Yu >Assignee: Harish Butani > Fix For: 0.8-incubating > > Attachments: ATLAS-247-v4.patch, ATLAS-247.2.patch, ATLAS-247.patch > > > hive_column is not inherited from DataSet, thus can't be using hive_process > to track column level lineages > Is there specific reason that hive_column is not inheriting from Data Set? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ATLAS-247) hive_column leve lineage
[ https://issues.apache.org/jira/browse/ATLAS-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vimal Sharma updated ATLAS-247: --- Attachment: (was: ATLAS-247-v3.patch) > hive_column leve lineage > > > Key: ATLAS-247 > URL: https://issues.apache.org/jira/browse/ATLAS-247 > Project: Atlas > Issue Type: New Feature >Affects Versions: 0.5-incubating >Reporter: Herman Yu >Assignee: Harish Butani > Fix For: 0.8-incubating > > Attachments: ATLAS-247-v4.patch, ATLAS-247.2.patch, ATLAS-247.patch > > > hive_column is not inherited from DataSet, thus can't be using hive_process > to track column level lineages > Is there specific reason that hive_column is not inheriting from Data Set? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ATLAS-247) hive_column leve lineage
[ https://issues.apache.org/jira/browse/ATLAS-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vimal Sharma updated ATLAS-247: --- Attachment: ATLAS-247-v3.patch > hive_column leve lineage > > > Key: ATLAS-247 > URL: https://issues.apache.org/jira/browse/ATLAS-247 > Project: Atlas > Issue Type: New Feature >Affects Versions: 0.5-incubating >Reporter: Herman Yu >Assignee: Harish Butani > Attachments: ATLAS-247-v3.patch, ATLAS-247.2.patch, ATLAS-247.patch > > > hive_column is not inherited from DataSet, thus can't be using hive_process > to track column level lineages > Is there specific reason that hive_column is not inheriting from Data Set? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ATLAS-247) hive_column leve lineage
[ https://issues.apache.org/jira/browse/ATLAS-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vimal Sharma updated ATLAS-247: --- Attachment: (was: ATLAS-247.patch) > hive_column leve lineage > > > Key: ATLAS-247 > URL: https://issues.apache.org/jira/browse/ATLAS-247 > Project: Atlas > Issue Type: New Feature >Affects Versions: 0.5-incubating >Reporter: Herman Yu >Assignee: Harish Butani > Attachments: ATLAS-247.2.patch, ATLAS-247.patch > > > hive_column is not inherited from DataSet, thus can't be using hive_process > to track column level lineages > Is there specific reason that hive_column is not inheriting from Data Set? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ATLAS-247) hive_column leve lineage
[ https://issues.apache.org/jira/browse/ATLAS-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vimal Sharma updated ATLAS-247: --- Attachment: ATLAS-247.patch Made some changes to apply the patch. The lineage information is not being set correctly in Hive. {code} public static Map> buildLineageMap(LineageInfo lInfo) { Map> m = new HashMap<>(); for(Map.Entry e : lInfo.entrySet()) { List l = new ArrayList<>(); ColumnName k = new ColumnName(e.getKey()); System.out.println(k.toString()); System.out.println("Col Lineage Key : " + e.getKey()); System.out.println("Col Lineage Value: " + e.getValue()); {code} The dependency value e.getValue() is null. The source column in a column lineage is not being populated in Hive SessionState. Seems like a bug with Hive fix at https://issues.apache.org/jira/browse/HIVE-13112. Will follow up with Hive team to identify the issue. > hive_column leve lineage > > > Key: ATLAS-247 > URL: https://issues.apache.org/jira/browse/ATLAS-247 > Project: Atlas > Issue Type: New Feature >Affects Versions: 0.5-incubating >Reporter: Herman Yu >Assignee: Harish Butani > Attachments: ATLAS-247.2.patch, ATLAS-247.patch, ATLAS-247.patch > > > hive_column is not inherited from DataSet, thus can't be using hive_process > to track column level lineages > Is there specific reason that hive_column is not inheriting from Data Set? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ATLAS-247) hive_column leve lineage
[ https://issues.apache.org/jira/browse/ATLAS-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harish Butani updated ATLAS-247: Attachment: ATLAS-247.2.patch > hive_column leve lineage > > > Key: ATLAS-247 > URL: https://issues.apache.org/jira/browse/ATLAS-247 > Project: Atlas > Issue Type: New Feature >Affects Versions: 0.5-incubating >Reporter: Herman Yu >Assignee: Harish Butani > Attachments: ATLAS-247.2.patch, ATLAS-247.patch > > > hive_column is not inherited from DataSet, thus can't be using hive_process > to track column level lineages > Is there specific reason that hive_column is not inheriting from Data Set? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ATLAS-247) hive_column leve lineage
[ https://issues.apache.org/jira/browse/ATLAS-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shwetha G S updated ATLAS-247: -- Attachment: ATLAS-247.patch Initial patch from Harish > hive_column leve lineage > > > Key: ATLAS-247 > URL: https://issues.apache.org/jira/browse/ATLAS-247 > Project: Atlas > Issue Type: New Feature >Affects Versions: 0.5-incubating >Reporter: Herman Yu >Assignee: Harish Butani > Attachments: ATLAS-247.patch > > > hive_column is not inherited from DataSet, thus can't be using hive_process > to track column level lineages > Is there specific reason that hive_column is not inheriting from Data Set? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (ATLAS-247) hive_column leve lineage
[ https://issues.apache.org/jira/browse/ATLAS-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shwetha G S updated ATLAS-247: -- Assignee: Harish Butani > hive_column leve lineage > > > Key: ATLAS-247 > URL: https://issues.apache.org/jira/browse/ATLAS-247 > Project: Atlas > Issue Type: New Feature >Affects Versions: 0.5-incubating >Reporter: Herman Yu >Assignee: Harish Butani > > hive_column is not inherited from DataSet, thus can't be using hive_process > to track column level lineages > Is there specific reason that hive_column is not inheriting from Data Set? -- This message was sent by Atlassian JIRA (v6.3.4#6332)