[
https://issues.apache.org/jira/browse/NIFI-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393138#comment-17393138
]
ASF subversion and git services commented on NIFI-8996:
-------------------------------------------------------
Commit a239eea8ff07e836d391ff0c5e73503c28369d9b in nifi's branch
refs/heads/main from Peter Turcsanyi
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=a239eea ]
NIFI-8996: Close JDBC statements in PutHive*QL processors.
Signed-off-by: Matthew Burgess <[email protected]>
This closes #5280
> PutHive*QL processors do not close JDBC statements
> --------------------------------------------------
>
> Key: NIFI-8996
> URL: https://issues.apache.org/jira/browse/NIFI-8996
> Project: Apache NiFi
> Issue Type: Bug
> Affects Versions: 1.11.4, 1.12.1, 1.14.0, 1.13.2
> Reporter: Peter Turcsanyi
> Assignee: Peter Turcsanyi
> Priority: Major
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> When multiple HiveQL statements arrive in a FlowFile, PutHive*QL processors
> create and execute the statements in a loop but do not close them. It may
> lead to data loss.
> Example scenario:
> * create a source table with 100 Mio records (single int column with random
> numbers)
> * create 10 target tables with the same structure
> * feed PutHive3QL with a single FF containing the following script:
> {code:java}
> truncate table target0;
> insert into target0 select * from source;
> truncate table target1;
> insert into target1 select * from source;
> ...{code}
> * result: some target tables are empty instead of having the 100 Mio records
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
