[
https://issues.apache.org/jira/browse/NIFI-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311588#comment-17311588
]
Joe Witt commented on NIFI-8384:
--------------------------------
You are definitely leaking sockets.
java XXXXX XXXXX *194u sock 0,7 0t0 29769295
protocol: TCP
java XXXXX XXXXX *195u sock 0,7 0t0 29769296
protocol: TCP
java XXXXX XXXXX *196u sock 0,7 0t0 29769297
protocol: TCP
java XXXXX XXXXX *197u sock 0,7 0t0 29769298
protocol: TCP
java XXXXX XXXXX *198u sock 0,7 0t0 29769299
protocol: TCP
java XXXXX XXXXX *199u sock 0,7 0t0 29769300
protocol: TCP
java XXXXX XXXXX *200u sock 0,7 0t0 29769301
protocol: TCP
java XXXXX XXXXX *201u sock 0,7 0t0 29769302
protocol: TCP
java XXXXX XXXXX *202u sock 0,7 0t0 29769303
protocol: TCP
java XXXXX XXXXX *203u sock 0,7 0t0 29769304
protocol: TCP
java XXXXX XXXXX *204u sock 0,7 0t0 29769305
protocol: TCP
java XXXXX XXXXX *205u sock 0,7 0t0 29769306
protocol: TCP
java XXXXX XXXXX *206u sock 0,7 0t0 29769307
protocol: TCP
java XXXXX XXXXX *207u sock 0,7 0t0 29769308
protocol: TCP
java XXXXX XXXXX *208u sock 0,7 0t0 29769309
protocol: TCP
java XXXXX XXXXX *209u sock 0,7 0t0 29769310
protocol: TCP
java XXXXX XXXXX *210u sock 0,7 0t0 29769311
protocol: TCP
java XXXXX XXXXX *211u sock 0,7 0t0 29769312
protocol: TCP
java XXXXX XXXXX *212u sock 0,7 0t0 29769313
protocol: TCP
java XXXXX XXXXX *213u sock 0,7 0t0 29769314
protocol: TCP
java XXXXX XXXXX *214u sock 0,7 0t0 29769315
protocol: TCP
java XXXXX XXXXX *215u sock 0,7 0t0 29769316
protocol: TCP
java XXXXX XXXXX *216u sock 0,7 0t0 29769317
protocol: TCP
java XXXXX XXXXX *217u sock 0,7 0t0 29769318
protocol: TCP
java XXXXX XXXXX *218u sock 0,7 0t0 29769319
protocol: TCP
java XXXXX XXXXX *219u sock 0,7 0t0 29769320
protocol: TCP
java XXXXX XXXXX *220u sock 0,7 0t0 29769321
protocol: TCP
java XXXXX XXXXX *221u sock 0,7 0t0 29769322
protocol: TCP
java XXXXX XXXXX *222u sock 0,7 0t0 29769323
protocol: TCP
java XXXXX XXXXX *223u sock 0,7 0t0 29769324
protocol: TCP
It is very possible your JVM is doing this. We found something similar
recently and changing the JDK version solved it. Not about nifi at all. It
was Java 8 271 though... If not please try this flow on NIFi 1.13.2 and let us
know.
> NiFi 1.12.1 : Too many open files
> ---------------------------------
>
> Key: NIFI-8384
> URL: https://issues.apache.org/jira/browse/NIFI-8384
> Project: Apache NiFi
> Issue Type: Bug
> Affects Versions: 1.12.1
> Environment: RHEL 7.8
> java version 1.8.0_281
> Reporter: Roberta
> Priority: Major
> Attachments: lsof_output.zip
>
>
> Hi All,
> Hope everything is fine. I’m writing you as we are experiencing a problem in
> Nifi 1.12.1 on a RHEL 7.8 with java version "1.8.0_281" .
> It is a single node, secured, without any load balancer upstream. However, it
> does have a s2s (it process provenance from another machine), ListSFTP +
> FetchSFTP processors as well as the ExecuteStreamCommand processor.
> After few days running NiFi suddenly shuts down reporting the following
> message:
> INFO [main]org.apache.nifi.bootstrap.Command Apache NiFi is running at PID
> XXXX but is not responding to ping requests
> Looking at the log file we are facing the following WARN:
> WARN [NiFi Web Server-XX-acceptor-X@XXXX
> -ServerConnector@XXXX\{SSL,[ssl,
> http/1.1]}{hostname:9443}]
> o.eclipse.jetty.server.AbstractConnector java.io.IOException: Too many open
> files
> We tried to fix the problem my means of the best practice configurations
> ([https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#configuration-best-practices])
> but the problem persists.
> After some research we found out that a possible cause might be the use of
> the processor FetchSFTP that we use in our flow. It creates always new files
> during SFTP connections (https://issues.apache.org/jira/browse/NIFI-7222). We
> would like to substitute the .nar file you attached to jira but,
> unfortunately, it is no more available.
> Based on your experience, is it possible that the bug found in NiFi 11.1.4
> and 1.12.0 could still be present in the 1.12.1?
> Thank you in advance for your support and let me know if you need further
> details
--
This message was sent by Atlassian Jira
(v8.3.4#803005)