[
https://issues.apache.org/jira/browse/MINIFICPP-788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17758035#comment-17758035
]
Martin Zink commented on MINIFICPP-788:
---------------------------------------
I think it would be best if we make this processor single-threaded only. (Its
best to make sure it doesnt break old configs)
> GetFile multithreading: directory listing should be single-threaded
> -------------------------------------------------------------------
>
> Key: MINIFICPP-788
> URL: https://issues.apache.org/jira/browse/MINIFICPP-788
> Project: Apache NiFi MiNiFi C++
> Issue Type: Bug
> Reporter: Arpad Boda
> Priority: Minor
>
> While working on MINIFICPP-786 I found that multithreading might be
> ineffective in some edgecase.
> While multiple consumers are fine (they create flow files from the listed
> files), producer should be single-threaded. Listing the same folder in
> parallel threads seems to make few sense.
> This can only occur in case listing takes longer than scheduling/configured
> time and it adds no files to the queue. This shouldn't occur frequently, but
> I can imagine edge-cases, like using getfile on a folder with a lot of files,
> while age/size/regex properties filter most of those.
> In my opnion simply skip listing in case listing is already being executed
> would be a slight improvement in such cases.
> Set prio to minor as it's really an edgecase.
> [~phrocker] what's your opinion?
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
