[
https://issues.apache.org/jira/browse/NIFI-10226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17570773#comment-17570773
]
Pierre Villard commented on NIFI-10226:
---------------------------------------
[~jzahner] - you could set the record writer in ListSFTP so that only one large
flow file is produced. Then you could use SplitRecord to split flow file by
subsets of say 10000 records per flow file, and then PartitionRecord to extract
the values you need as attributes before sending into your Fetch processor.
> Empty Queue 1'500'000 flowfiles - NiFi GUI HTTP Error 503
> ---------------------------------------------------------
>
> Key: NIFI-10226
> URL: https://issues.apache.org/jira/browse/NIFI-10226
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core UI
> Affects Versions: 1.15.3
> Environment: 8-Node cluster
> Reporter: Josef Zahner
> Priority: Major
> Attachments: Screenshot 2022-07-13 at 13.46.23.png,
> image-2022-07-14-12-23-15-980.png, image-2022-07-14-12-28-58-329.png
>
>
> We have a ListSFTP processor which produces 1'500'000 flowfiles as output.
> When we try to "Empty Queue" it takes multiple minutes and the GUI shows a
> HTTP 503 error during that period. We can't open the GUI again until the
> deletion is complete. Those flowfiles are all on the primary node and not
> load balanced within the cluster. Below is the final GUI message. The
> intermediate message looks similar but without the removed string.
> !Screenshot 2022-07-13 at 13.46.23.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
