bbende commented on issue #3597: NIFI-6462 ListHDFS should be triggerable
URL: https://github.com/apache/nifi/pull/3597#issuecomment-514214460
 
 
   ListHDFS is meant to maintain state for a specific directory and find newer 
files during each execution. This works because the processor knows it is 
tracking a single directory and can detect when the user changes the Directory 
property. By allowing incoming flow files it means the processor is now 
tracking a potentially infinite number of directories which are coming 
dynamically from incoming flow files.
   
   This was discussed a few times on the mailing list and the general consensus 
was to leave ListHDFS and implement an alternate processor that supported 
incoming flow files, but did not maintain state, basically a one-time listing. 
I believe GetHDFSFileInfo already provides this functionality.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to