[
https://issues.apache.org/jira/browse/NIFI-7114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17034216#comment-17034216
]
Paul Kelly commented on NIFI-7114:
----------------------------------
We are also experiencing this issue since version 1.10.0 under both Java 8 and
Java 11. On Windows, it manifested as TCP port exhaustion while on Linux we
are running out of available file handles regardless of how high we set the
limit. Netstat on Windows showed we had several thousand pairs of established
connections between high random ports on localhost that belonged to the NiFi
process while on Linux we saw a growing number of pipes in use. Reverting to
NiFi 1.9.2 resolved the problem for us on both systems. Our Windows system
isn't heavily loaded, and we only noticed the port exhaustion problem after
setting up a flow with a PutDistributedMapCache processor writing to a
DistributedMapCacheServer controller service running on the same NiFi instance.
I'm not sure if the DistributedMapCache flow is related to the problem or if
it just caused enough increased activity for us to run out of ports faster than
we had been before.
> NiFi not closing file handles
> -----------------------------
>
> Key: NIFI-7114
> URL: https://issues.apache.org/jira/browse/NIFI-7114
> Project: Apache NiFi
> Issue Type: Bug
> Components: Configuration
> Affects Versions: 1.10.0, 1.11.0
> Environment: Amazon EC2 running either Amazon Linux 2 or Ubuntu 18.04.
> NiFi has been installed with no change to any configuration file.
> Reporter: Vinicius Zolin
> Priority: Major
> Fix For: 1.11.2
>
> Attachments: destination.xml, lsof.log, lsofAfter.log,
> lsofBefore.log, source.xml
>
>
> Since at least version 1.10 NiFi stopped closing file handles. It opens circa
> 500 files per hour (measured using lsof) without any apparent limit until it
> crashes due to too many open files.
>
> Increasing the computer open file limit is not a solution since NiFi will
> still crash, it'll only take longer to do so.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
