[ 
https://issues.apache.org/jira/browse/NIFI-10226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566818#comment-17566818
 ] 

Josef Zahner commented on NIFI-10226:
-------------------------------------

Btw. today the cluster drops the same 1'500'000 flowfiles within a few seconds, 
so no SocketTimeout anymore. And we can't workaround the number of flowfiles, 
as we are doing a ListSFTP for a very large folder with 1'500'000 files, when 
it run once we always get all the files. The possibility to filter regex is 
there, but it would be very complicated to get all files.

> Empty Queue 1'500'000 flowfiles - NiFi GUI HTTP Error 503
> ---------------------------------------------------------
>
>                 Key: NIFI-10226
>                 URL: https://issues.apache.org/jira/browse/NIFI-10226
>             Project: Apache NiFi
>          Issue Type: Bug
>          Components: Core UI
>    Affects Versions: 1.15.3
>         Environment: 8-Node cluster
>            Reporter: Josef Zahner
>            Priority: Major
>         Attachments: Screenshot 2022-07-13 at 13.46.23.png, 
> image-2022-07-14-12-23-15-980.png, image-2022-07-14-12-28-58-329.png
>
>
> We have a ListSFTP processor which produces 1'500'000 flowfiles as output. 
> When we try to "Empty Queue" it takes multiple minutes and the GUI shows a 
> HTTP 503 error during that period. We can't open the GUI again until the 
> deletion is complete. Those flowfiles are all on the primary node and not 
> load balanced within the cluster.  Below is the final GUI message. The 
> intermediate message looks similar but without the removed string.
> !Screenshot 2022-07-13 at 13.46.23.png!



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to