[
https://issues.apache.org/jira/browse/NIFI-7114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17042224#comment-17042224
]
Joe Witt commented on NIFI-7114:
--------------------------------
good command to use in the future for fun leak hunting
lsof +E -P -p 347813 | tr -s " " | cut -d" " -f5 | sort | uniq -c
replace 347813 with pid of actual nifi process. This counts how many instances
of each type of File Descriptor are found. Helps narrow down the type of
leaks. IN the past we had to find leaking sockets/IPv4. This time it was
FIFO, unix, a_inode stuff which made it more fun.
> NiFi not closing file handles
> -----------------------------
>
> Key: NIFI-7114
> URL: https://issues.apache.org/jira/browse/NIFI-7114
> Project: Apache NiFi
> Issue Type: Bug
> Components: Configuration
> Affects Versions: 1.10.0, 1.11.0
> Environment: Amazon EC2 running either Amazon Linux 2 or Ubuntu 18.04.
> NiFi has been installed with no change to any configuration file.
> Reporter: Vinicius Zolin
> Assignee: Matt Burgess
> Priority: Blocker
> Fix For: 1.12.0, 1.11.3
>
> Attachments: destination.xml, fifocounts.txt, flow.xml.gz, lsof.log,
> lsof.zip, lsofAfter.log, lsofBefore.log, openFiles.xlsx, reproduction.zip,
> source.xml
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Since at least version 1.10 NiFi stopped closing file handles. It opens circa
> 500 files per hour (measured using lsof) without any apparent limit until it
> crashes due to too many open files.
>
> Increasing the computer open file limit is not a solution since NiFi will
> still crash, it'll only take longer to do so.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
