[
https://issues.apache.org/jira/browse/NIFI-13829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17887289#comment-17887289
]
ASF subversion and git services commented on NIFI-13829:
--------------------------------------------------------
Commit 7da06aab6296b6d32d0133dbbdd85c489a5709f1 in nifi's branch
refs/heads/main from Rajmund Takacs
[ https://gitbox.apache.org/repos/asf?p=nifi.git;h=7da06aab62 ]
NIFI-13829: Mitigate false positive reports of MonitorActivity, in case of
infrequent Flow Files
This closes #9333.
Signed-off-by: Tamas Palfy <[email protected]>
> MonitorActivity processor generating false inactivity files
> -----------------------------------------------------------
>
> Key: NIFI-13829
> URL: https://issues.apache.org/jira/browse/NIFI-13829
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
> Affects Versions: 1.27.0, 2.0.0-M4
> Reporter: Rajmund Takacs
> Assignee: Rajmund Takacs
> Priority: Major
> Attachments: MonitorActivity_testing_adv_OSS.json
>
>
> MonitorActivity generates false inactivity reports (with big ratio), if the
> FlowFiles are coming less frequent, than the 2/3 of the configured threshold.
> This happens only in cluster monitoring scope, where only primary node
> reports, and only non-primary nodes have FlowFiles to process.
> This is because, the processor synchronizes the common state only 3 times
> within the threshold: 1T/3, 2T/3, 3T/3. If the FlowFile hits the non-primary
> node between the second (2T/3) and the third sync point (3T/3), then the
> state from the non-primary node will only be shared with the primary node,
> when the last sync point comes. And as sync points are relativeley calculated
> by each node, there is a race condition in terms of which happens first: the
> primary node reads the common state, or the non-primary node writes the new
> state. In case of the former, primary node will generate a false indication.
> {noformat}
> [PRIMARY] - SY0 ---- SY1 ----- SY2 ---- SY3 ---- SY4 ----
> / / / / ? /
> [C STATE] ------X---:---------:--------:-------:X-:------
> / / / /
> [SLAVE N] -- FF1 ---- SY1 ---- SY2 -- FF2 -- SY3 --------
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
