[
https://issues.apache.org/jira/browse/NIFI-12148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dmytro Firsov updated NIFI-12148:
---------------------------------
Description:
JVM heap size is constantly grows when using Hive3Streaming processor,
depending on flowfile rate (higher rate -> faster growing). Even when processor
is stopped (or deleted) memory is not freed.
Without Hive3Streaming processor - no leaks.
Hadoop: 3.3.6, Hive 4.0.0-beta-1, NiFi - 1.23.2
Also tried: Hadoop 3.3.6, Hive 3.1.2, NiFi - 1.19.1 - same issue.
I have created jvm memory dump with Jmap and with Eclipse Memory Analyzer got
these results:
!image-2023-09-29-15-46-17-207.png!
!image-2023-09-29-15-48-15-931.png!
was:
JVM heap size is constantly grows when using Hive3Streaming processor,
depending on flowfile rate (higher rate -> faster growing). Even when processor
is stopped (or deleted) memory is not freed.
Without Hive3Streaming processor - no leaks.
Hadoop: 3.3.6, Hive 4.0.0-beta-1, NiFi - 1.23.2
Also tried: Hadoop 3.3.6, Hive 3.1.2, NiFi - 1.19.1 - same issue.
I create jvm memory dump with Jmap and with Eclipse Memory Analyzer these
results:
!image-2023-09-29-15-46-17-207.png!
!image-2023-09-29-15-48-15-931.png!
> NiFi Hive3Streaming memory leak
> -------------------------------
>
> Key: NIFI-12148
> URL: https://issues.apache.org/jira/browse/NIFI-12148
> Project: Apache NiFi
> Issue Type: Bug
> Affects Versions: 1.19.1, 1.23.2
> Reporter: Dmytro Firsov
> Priority: Major
> Attachments: image-2023-09-29-15-46-17-207.png,
> image-2023-09-29-15-48-15-931.png
>
>
> JVM heap size is constantly grows when using Hive3Streaming processor,
> depending on flowfile rate (higher rate -> faster growing). Even when
> processor is stopped (or deleted) memory is not freed.
> Without Hive3Streaming processor - no leaks.
> Hadoop: 3.3.6, Hive 4.0.0-beta-1, NiFi - 1.23.2
> Also tried: Hadoop 3.3.6, Hive 3.1.2, NiFi - 1.19.1 - same issue.
> I have created jvm memory dump with Jmap and with Eclipse Memory Analyzer got
> these results:
> !image-2023-09-29-15-46-17-207.png!
> !image-2023-09-29-15-48-15-931.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
