[ 
https://issues.apache.org/jira/browse/NIFI-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16246149#comment-16246149
 ] 

ASF subversion and git services commented on NIFI-4545:
-------------------------------------------------------

Commit 37ef2839e00a31c33b13da98dcb7aebe9ea77923 in nifi's branch 
refs/heads/master from [~ijokarumawak]
[ https://git-wip-us.apache.org/repos/asf?p=nifi.git;h=37ef283 ]

NIFI-4545: Improve Hive processors provenance transit URL

Incorporated review comments:

- Added 'input' to equals() method so that the same table name can appear
as input and output tables.

Signed-off-by: Matthew Burgess <[email protected]>

This closes #2239


> Improve Hive processors provenance transit URL
> ----------------------------------------------
>
>                 Key: NIFI-4545
>                 URL: https://issues.apache.org/jira/browse/NIFI-4545
>             Project: Apache NiFi
>          Issue Type: Improvement
>          Components: Extensions
>            Reporter: Koji Kawamura
>            Assignee: Koji Kawamura
>             Fix For: 1.5.0
>
>
> Hive-related processors report NiFi provenance events with transit URLs in a 
> format as 'jdbc:hive2://<host1>:<port1>,<host2>:<port2>/dbName'. The URL 
> format can identify a Hive environment, but not descriptive enough to derive 
> actual table names affecting or being affected by the query which generated 
> the provenance event.
> Those table information can only be known by parsing query. This JIRA 
> improves following Hive related processors to write additional 
> 'query.input.tables' and 'query.output.tables' FlowFile attributes by parsing 
> Hive queries using Hive parser.
> Target Processors:
> * PutHiveQL
> * SelectHiveQL
> * PutHiveStreaming: This processor knows a table name without the need of 
> parsing queries.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to