Arpad Boda created MINIFICPP-788:
------------------------------------
Summary: GetFile multithreading: directory listing should be
single-threaded
Key: MINIFICPP-788
URL: https://issues.apache.org/jira/browse/MINIFICPP-788
Project: NiFi MiNiFi C++
Issue Type: Bug
Reporter: Arpad Boda
Assignee: Arpad Boda
While working on MINIFICPP-786 I found that multithreading might be ineffective
in some edgecase.
While multiple consumers are fine (they create flow files from the listed
files), producer should be single-threaded. Listing the same folder in parallel
threads seems to make few sense.
This can only occur in case listing takes longer than scheduling/configured
time and it adds no files to the queue. This shouldn't occur frequently, but I
can imagine edge-cases, like using getfile on a folder with a lot of files,
while age/size/regex properties filter most of those.
In my opnion simply skip listing in case listing is already being executed
would be a slight improvement in such cases.
Set prio to minor as it's really an edgecase.
[~phrocker] what's your opinion?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
