Bob Paulin created NIFI-14003:
---------------------------------
Summary: NiFi Stateless Engine gets stuck calling a Merge
Processor repeated
Key: NIFI-14003
URL: https://issues.apache.org/jira/browse/NIFI-14003
Project: Apache NiFi
Issue Type: Bug
Components: NiFi Stateless
Affects Versions: 2.0.0
Reporter: Bob Paulin
Attachments: merge-test.json
I have a custom processor that collects files that have been split from a prior
processor (see [^merge-test.json] for similar setup). When I run this
configuration in stateless the merge processor continues to run without
attempting any of the other ready processors that are required to defragment
the FlowFile (see [1] as the ready queue always tries only the latest added
processor). We need a means for the stateless engine to rotate through
processors in stateless mode so that a downstream processor doesn't get stuck
waiting for data from a processor that will never be selected from the ready
queue. Otherwise these processors will almost always fail if they are
receiving data from more than one source.
[1]https://github.com/apache/nifi/blob/6c4ddf86310187e093070446412c4b2314bd324a/nifi-stateless/nifi-stateless-bundle/nifi-stateless-engine/src/main/java/org/apache/nifi/stateless/session/AsynchronousCommitTracker.java#L81
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
