[ 
https://issues.apache.org/jira/browse/NIFI-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Turcsanyi updated NIFI-8996:
----------------------------------
    Status: Patch Available  (was: In Progress)

> PutHive*QL processors do not close JDBC statements
> --------------------------------------------------
>
>                 Key: NIFI-8996
>                 URL: https://issues.apache.org/jira/browse/NIFI-8996
>             Project: Apache NiFi
>          Issue Type: Bug
>    Affects Versions: 1.13.2, 1.14.0, 1.12.1, 1.11.4
>            Reporter: Peter Turcsanyi
>            Assignee: Peter Turcsanyi
>            Priority: Major
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> When multiple HiveQL statements arrive in a FlowFile, PutHive*QL processors 
> create and execute the statements in a loop but do not close them. It may 
> lead to data loss.
> Example scenario:
>  * create a source table with 100 Mio records (single int column with random 
> numbers)
>  * create 10 target tables with the same structure
>  * feed PutHive3QL with a single FF containing the following script:
> {code:java}
> truncate table target0;
> insert into target0 select * from source;
> truncate table target1;
> insert into target1 select * from source;
> ...{code}
>  * result: some target tables are empty instead of having the 100 Mio records



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to