[
https://issues.apache.org/jira/browse/IMPALA-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16956414#comment-16956414
]
ASF subversion and git services commented on IMPALA-9070:
---------------------------------------------------------
Commit 378a108ecc3c70a73140155324249fa124bf7bdd in impala's branch
refs/heads/master from Anurag Mantripragada
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=378a108 ]
IMPALA-9070: Include table location in lineage for 'CREATE EXTERNAL
TABLE' DDL.
Atlas needs table location to establish lineage between a newly
created external table and its table location.
The table location information is not available until the createTable
catalog op succeeds. After this change, location information is sent
to the backend in the TDDLExecResponse message which adds it to the
lineage graph. This information is sent only for create external
table queries.
Testing:
Added a test to verify the tableLocation field is populated for a
create external table query lineage. Also, modified the
lineage.test file to include location information for all lineages.
Change-Id: If02b0cc16d52c1956298171628f5737cab62ce9f
Reviewed-on: http://gerrit.cloudera.org:8080/14515
Reviewed-by: Tim Armstrong <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Include table location information in lineage graphs for external tables.
> -------------------------------------------------------------------------
>
> Key: IMPALA-9070
> URL: https://issues.apache.org/jira/browse/IMPALA-9070
> Project: IMPALA
> Issue Type: Improvement
> Components: Frontend
> Reporter: Anurag Mantripragada
> Assignee: Anurag Mantripragada
> Priority: Critical
>
> Atlas needs table location information to establish lineage between table
> location and newly created external tables in Impala. This information should
> be sent to backend after successful table creation.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]