[
https://issues.apache.org/jira/browse/NIFI-14712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric Secules updated NIFI-14712:
--------------------------------
Description:
Background: I have a very large flow with 50000 or so processors and the
flow-analysis endpoint is taking 20 or more seconds to complete. This is likely
because the endpoint is traversing all the process groups recursively each time
it is called. While User A had the flow canvas open to the root node, User B
was unable to make configuration changes to the flow and also had a very hard
time making updates to the flow.
This endpoint also holds a read lock on the flow for the entire time, so it
will prevent any writes.
Suggestions:
# Short circuit this endpoint and return a default success value if there are
no violations at all.
# Only show detailed validation errors for the current process group and not
descendants in the UI. For process groups within the current process group,
show a cumulative count of violations within each process group. Counts would
be updated lazily.
# The UI only checks whether there exist violations at the current process
group and descendants, only load the detailed validation errors if the user
clicks on the first aid kit icon. A map of process groupID to boolean would be
updated at the same time violations are updated and a violation on a process
group would set the boolean to true for its ancestors up to the root.
Screenshots from browser dev tools attached
was:
Background: I have a very large flow with 50000 or so processors and the
flow-analysis endpoint is taking 20 or more seconds to complete. This is likely
because the endpoint is traversing all the process groups recursively each time
it is called. While User A had the flow canvas open to the root node, User B
was unable to make configuration changes to the flow and also had a very hard
time making updates to the flow.
This endpoint also holds a read lock on the flow for the entire time, so it
will prevent any writes.
Suggestions:
# Short circuit this endpoint and return a default success value if there are
no violations at all.
# Only show detailed validation errors for the current process group and not
descendants in the UI. For process groups within the current process group,
show a cumulative count of violations within each process group. Counts would
be updated lazily.
# The UI only checks whether there exist violations at the root level, only
load the detailed validation errors if the user clicks on the first aid kit
icon.
Screenshots from browser dev tools attached
> Performance issue with flow-analysis for a process group
> --------------------------------------------------------
>
> Key: NIFI-14712
> URL: https://issues.apache.org/jira/browse/NIFI-14712
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Affects Versions: 2.4.0
> Reporter: Eric Secules
> Priority: Major
> Attachments: Screenshot 2025-07-03 at 7.04.37 PM.png, Screenshot
> 2025-07-03 at 7.05.42 PM-1.png
>
>
> Background: I have a very large flow with 50000 or so processors and the
> flow-analysis endpoint is taking 20 or more seconds to complete. This is
> likely because the endpoint is traversing all the process groups recursively
> each time it is called. While User A had the flow canvas open to the root
> node, User B was unable to make configuration changes to the flow and also
> had a very hard time making updates to the flow.
> This endpoint also holds a read lock on the flow for the entire time, so it
> will prevent any writes.
> Suggestions:
> # Short circuit this endpoint and return a default success value if there
> are no violations at all.
> # Only show detailed validation errors for the current process group and not
> descendants in the UI. For process groups within the current process group,
> show a cumulative count of violations within each process group. Counts would
> be updated lazily.
> # The UI only checks whether there exist violations at the current process
> group and descendants, only load the detailed validation errors if the user
> clicks on the first aid kit icon. A map of process groupID to boolean would
> be updated at the same time violations are updated and a violation on a
> process group would set the boolean to true for its ancestors up to the root.
> Screenshots from browser dev tools attached
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
