[jira] [Commented] (ATLAS-3183) Read Impala lineage record for creating view and send to Atlas

2019-05-09 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-3183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16836119#comment-16836119
 ] 

ASF subversion and git services commented on ATLAS-3183:


Commit 2d23b037be339748e82b895075d22d93fdc22e0b in atlas's branch 
refs/heads/master from lina.li
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=2d23b03 ]

ATLAS-3183: Read Impala lineage record for creating view and send to Atlas #2 
remove impala-bridge-shim in pom.xml

Signed-off-by: Sarath Subramanian 


> Read Impala lineage record for creating view and send to Atlas
> --
>
> Key: ATLAS-3183
> URL: https://issues.apache.org/jira/browse/ATLAS-3183
> Project: Atlas
>  Issue Type: New Feature
>  Components:  atlas-core
>Affects Versions: 1.1.0
>Reporter: Na Li
>Assignee: Na Li
>Priority: Major
> Attachments: ATLAS-3183.010.patch
>
>
> Impala generates lineage records for its commands. This new feature will read 
> Impala lineage file, convert the lineage record to Atlas entities and send 
> them to Atlas. In this way, Atlas can get lineage of Impala operation.
> The metadata referred in the lineage are captured in Hive Metastore hook and 
> sent to Atlas. This work is done in 
> [ATLAS-3148|https://issues.apache.org/jira/browse/ATLAS-3148]
> This jira only supports the Impala command "create view". Following jira will 
> add support for more Impala commands.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (ATLAS-3183) Read Impala lineage record for creating view and send to Atlas

2019-05-08 Thread ASF subversion and git services (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-3183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16836015#comment-16836015
 ] 

ASF subversion and git services commented on ATLAS-3183:


Commit 3137bb2151abcc362008d7449f1e9a80d57b17a7 in atlas's branch 
refs/heads/master from lina.li
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=3137bb2 ]

ATLAS-3183: Read Impala lineage record for creating view and send to Atlas

Signed-off-by: Sarath Subramanian 


> Read Impala lineage record for creating view and send to Atlas
> --
>
> Key: ATLAS-3183
> URL: https://issues.apache.org/jira/browse/ATLAS-3183
> Project: Atlas
>  Issue Type: New Feature
>  Components:  atlas-core
>Affects Versions: 1.1.0
>Reporter: Na Li
>Assignee: Na Li
>Priority: Major
> Attachments: ATLAS-3183.010.patch
>
>
> Impala generates lineage records for its commands. This new feature will read 
> Impala lineage file, convert the lineage record to Atlas entities and send 
> them to Atlas. In this way, Atlas can get lineage of Impala operation.
> The metadata referred in the lineage are captured in Hive Metastore hook and 
> sent to Atlas. This work is done in 
> [ATLAS-3148|https://issues.apache.org/jira/browse/ATLAS-3148]
> This jira only supports the Impala command "create view". Following jira will 
> add support for more Impala commands.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (ATLAS-3183) Read Impala lineage record for creating view and send to Atlas

2019-05-08 Thread Na Li (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-3183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16835927#comment-16835927
 ] 

Na Li commented on ATLAS-3183:
--

[~sarath.ku...@gmail.com] Can you look at the latest code change, and see if we 
can commit the latest patch ATLAS-3183.010.patch? Thanks!

1) tests for ATLAS-3183.008.patch succeeded at 
https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/1089/console
2) ATLAS-3183.010.patch only differs from ATLAS-3183.008.patch in 
"addons/impala-bridge/src/main/resources/import-impala.sh", which does not 
affect test results.
3) pre-commit test for patch ATLAS-3183.010.patch is at 
https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/1090/console



> Read Impala lineage record for creating view and send to Atlas
> --
>
> Key: ATLAS-3183
> URL: https://issues.apache.org/jira/browse/ATLAS-3183
> Project: Atlas
>  Issue Type: New Feature
>  Components:  atlas-core
>Affects Versions: 1.1.0
>Reporter: Na Li
>Assignee: Na Li
>Priority: Major
> Attachments: ATLAS-3183.010.patch
>
>
> Impala generates lineage records for its commands. This new feature will read 
> Impala lineage file, convert the lineage record to Atlas entities and send 
> them to Atlas. In this way, Atlas can get lineage of Impala operation.
> The metadata referred in the lineage are captured in Hive Metastore hook and 
> sent to Atlas. This work is done in 
> [ATLAS-3148|https://issues.apache.org/jira/browse/ATLAS-3148]
> This jira only supports the Impala command "create view". Following jira will 
> add support for more Impala commands.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (ATLAS-3183) Read Impala lineage record for creating view and send to Atlas

2019-05-08 Thread Na Li (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-3183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16835833#comment-16835833
 ] 

Na Li commented on ATLAS-3183:
--

pre-commit test for patch ATLAS-3183.008.patch is at 
https://builds.apache.org/view/A/view/Atlas/job/PreCommit-ATLAS-Build-Test/1089/console

> Read Impala lineage record for creating view and send to Atlas
> --
>
> Key: ATLAS-3183
> URL: https://issues.apache.org/jira/browse/ATLAS-3183
> Project: Atlas
>  Issue Type: New Feature
>  Components:  atlas-core
>Affects Versions: 1.1.0
>Reporter: Na Li
>Assignee: Na Li
>Priority: Major
> Attachments: ATLAS-3183.006.patch, ATLAS-3183.007.patch, 
> ATLAS-3183.008.patch
>
>
> Impala generates lineage records for its commands. This new feature will read 
> Impala lineage file, convert the lineage record to Atlas entities and send 
> them to Atlas. In this way, Atlas can get lineage of Impala operation.
> The metadata referred in the lineage are captured in Hive Metastore hook and 
> sent to Atlas. This work is done in 
> [ATLAS-3148|https://issues.apache.org/jira/browse/ATLAS-3148]
> This jira only supports the Impala command "create view". Following jira will 
> add support for more Impala commands.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (ATLAS-3183) Read Impala lineage record for creating view and send to Atlas

2019-05-02 Thread Na Li (JIRA)


[ 
https://issues.apache.org/jira/browse/ATLAS-3183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831885#comment-16831885
 ] 

Na Li commented on ATLAS-3183:
--

tests passed for Impala-bridge

> Read Impala lineage record for creating view and send to Atlas
> --
>
> Key: ATLAS-3183
> URL: https://issues.apache.org/jira/browse/ATLAS-3183
> Project: Atlas
>  Issue Type: New Feature
>  Components:  atlas-core
>Affects Versions: 1.1.0
>Reporter: Na Li
>Assignee: Na Li
>Priority: Major
> Attachments: ATLAS-3183.002.patch, ATLAS-3183.004.patch, 
> ATLAS-3183.005.patch
>
>
> Impala generates lineage records for its commands. This new feature will read 
> Impala lineage file, convert the lineage record to Atlas entities and send 
> them to Atlas. In this way, Atlas can get lineage of Impala operation.
> The metadata referred in the lineage are captured in Hive Metastore hook and 
> sent to Atlas. This work is done in 
> [ATLAS-3148|https://issues.apache.org/jira/browse/ATLAS-3148]
> This jira only supports the Impala command "create view". Following jira will 
> add support for more Impala commands.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)