Ryan Hendrickson created NIFI-10823:
---------------------------------------
Summary: Backpressure Queue - Properties file vs. Canvas update,
Properties file not respected.
Key: NIFI-10823
URL: https://issues.apache.org/jira/browse/NIFI-10823
Project: Apache NiFi
Issue Type: Bug
Reporter: Ryan Hendrickson
Assignee: Mark Payne
I assigned this to Mark so he'd take notice since we were chatting about this
on the Apache NiFi Slack Channel:
[https://apachenifi.slack.com/archives/C0L9VCD47/p1668546036757219]
We have been setting the following two nifi.properties for quite some time...
* nifi.queue.backpressure.count=20000
* nifi.queue.swap.threshold=20000
Today we updated the dataflow on with a NiFi that can have a huge amount of
FlowFiles queue up if backpressure isn't set correctly. We realized that the
new relationships drawn on the canvas did not inherit the
nifi.queue.backpressure.count set in nifi.properties. (Discussion on Slack)
Hunting back, it looks like NIFI-8195 in NiFi 1.14.0 attempted to Migrate
backpressure settings from nifi.properties to the Process Groups in the UI.
# It looks like in the Pull Request, it was intended to read the
nifi.properties file value and set that to the root process group value.
## [https://github.com/apache/nifi/pull/5192,]
## "verified the default values of the added elements are “0 sec” for FlowFile
Expiration, and obtained from nifi.properties for back pressure settings" and
## "The backpressure defaults from nifi.properties should only be used when at
the root level"
# The Migration Guidance from 1.14.0 doesn't say anything about the
nifi.properties `nifi.queue.backpressure.count` no longer being used.
[https://cwiki.apache.org/confluence/display/NIFI/Migration+Guidance]
# The core properties still have it listed:
[https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#core-properties]
Version: Apache NiFi 1.16.3 Stanealone and Cluster
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
