Xinyu Wang created NIFI-16125:
---------------------------------
Summary: Parallelize the initial component validation sweep during
flow startup
Key: NIFI-16125
URL: https://issues.apache.org/jira/browse/NIFI-16125
Project: Apache NiFi
Issue Type: Improvement
Components: Core Framework
Affects Versions: 2.10.0, 2.5.0
Reporter: Xinyu Wang
During flow initialization the Flow Controller performs a one-time validation
pass over every component before scheduled/enabled components are started. This
pass runs synchronously on the startup thread, one component at a time. For
large flows (tens of thousands of components) it adds a measurable, avoidable
delay to every startup and cluster (re)join, spent on a single CPU core while
the rest sit idle.
*Proposed change*
Fan the initial sweep out over the existing \{{validationThreadPool}} instead
of validating one component at a time, then barrier before returning
(subsequent startup steps assume components have reached a terminal validation
state).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
