[
https://issues.apache.org/jira/browse/NIFI-7114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17042017#comment-17042017
]
Joe Witt commented on NIFI-7114:
--------------------------------
What I'm seeing grow is the number of FIFO by 2 and the number unix type
descriptors. I see this by running the following command over and over
lsof +E -P -p 230830 | tr -s " " | cut -d" " -f5 | sort | uniq -c
41 a_inode
7 CHR
4 DIR
86 FIFO
9 IPv4
5737 REG
1 TYPE
33 unix
So now it is about seeing precisely which file descriptors relevant to
FIFO/unix are changing in those sets.
So I run the following command a couple times over time to generate new output
in diff files.
lsof +E -P -p 230830 | tr -s " " | grep -v CHR | grep -v DIR | grep -v IPv4 |
grep -v REG | grep -v TYPE | sort | tee ~/Downloads/debug-pipes-1134.txt
Then diff.
Get something like
171a172
> java 230830 nifi 3051u a_inode 0,14 0 15578 [eventpoll]
173a175
> java 230830 nifi 3056u unix 0x00000000c69364e8 0t0 30110755 type=STREAM
175,177c177,181
< java 230830 nifi 3058r FIFO 0,13 0t0 25310688 pipe 230830,java,3059w
< java 230830 nifi 3059w FIFO 0,13 0t0 25310688 pipe 230830,java,3058r
< java 230830 nifi 3060u a_inode 0,14 0 15578 [eventpoll]
---
> java 230830 nifi 3058r FIFO 0,13 0t0 25310689 pipe 230830,java,3062w
> java 230830 nifi 3060r FIFO 0,13 0t0 25295731 pipe 230830,java,3061w
> java 230830 nifi 3061w FIFO 0,13 0t0 25295731 pipe 230830,java,3060r
> java 230830 nifi 3062w FIFO 0,13 0t0 25310689 pipe 230830,java,3058r
> java 230830 nifi 3065u a_inode 0,14 0 15578 [eventpoll]
> NiFi not closing file handles
> -----------------------------
>
> Key: NIFI-7114
> URL: https://issues.apache.org/jira/browse/NIFI-7114
> Project: Apache NiFi
> Issue Type: Bug
> Components: Configuration
> Affects Versions: 1.10.0, 1.11.0
> Environment: Amazon EC2 running either Amazon Linux 2 or Ubuntu 18.04.
> NiFi has been installed with no change to any configuration file.
> Reporter: Vinicius Zolin
> Priority: Major
> Attachments: destination.xml, fifocounts.txt, flow.xml.gz, lsof.log,
> lsof.zip, lsofAfter.log, lsofBefore.log, openFiles.xlsx, reproduction.zip,
> source.xml
>
>
> Since at least version 1.10 NiFi stopped closing file handles. It opens circa
> 500 files per hour (measured using lsof) without any apparent limit until it
> crashes due to too many open files.
>
> Increasing the computer open file limit is not a solution since NiFi will
> still crash, it'll only take longer to do so.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
