[
https://issues.apache.org/jira/browse/NIFI-7114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17037758#comment-17037758
]
Paul Kelly commented on NIFI-7114:
----------------------------------
I was able to reproduce the issue with a stripped down flow. I'm not sure
which component is causing the leak, but this at least represents both our
sending and receiving production flows. Please see the attached
reproduction.zip file. Inside are the sample flow.xml.gz file, lsof logs from
around the start and end of the test which shows FIFO usage associated with the
NiFi process grew from 783 to 6,643 overnight, a log file tracking FIFO usage
throughout the night (watch -n 30 'date >> runningfifocount.log;lsof | grep
FIFO | wc -l >> runningfifocount.log') – I forgot to strip it down before
uploading, the final test starts around line 286, "Sun Feb 16 00:52:27 UTC
2020" – plus a thread dump and a heap dump from in the morning.
To generate sample files for the GetFile processor, I left the following
running in a separate terminal window to generate large sample files: watch -n
1 'dd if=/dev/zero of=file`date +%s` bs=32M count=3'
As also shown by [~vzolin], our FIFO usage doesn't start growing until almost
two hours in. At that point it jumps up and continues to grow steadily
afterwards.
Please let me know if there is anything else I can provide. Thank you for
looking into this. We aren't able to use NiFi >1.10.0 because of this issue.
> NiFi not closing file handles
> -----------------------------
>
> Key: NIFI-7114
> URL: https://issues.apache.org/jira/browse/NIFI-7114
> Project: Apache NiFi
> Issue Type: Bug
> Components: Configuration
> Affects Versions: 1.10.0, 1.11.0
> Environment: Amazon EC2 running either Amazon Linux 2 or Ubuntu 18.04.
> NiFi has been installed with no change to any configuration file.
> Reporter: Vinicius Zolin
> Priority: Major
> Attachments: destination.xml, lsof.log, lsof.zip, lsofAfter.log,
> lsofBefore.log, openFiles.xlsx, reproduction.zip, source.xml
>
>
> Since at least version 1.10 NiFi stopped closing file handles. It opens circa
> 500 files per hour (measured using lsof) without any apparent limit until it
> crashes due to too many open files.
>
> Increasing the computer open file limit is not a solution since NiFi will
> still crash, it'll only take longer to do so.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
