Tushar Gosavi created APEXMALHAR-2250:

             Summary: AbstractFileInputOperator.DirectoryScanner does not 
handle directories correctly.
                 Key: APEXMALHAR-2250
                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2250
             Project: Apache Apex Malhar
          Issue Type: Bug
            Reporter: Tushar Gosavi

The default DirectoryScanner defined in AbstractFileInputOperator does not 
handle directories correctly. If there is a directory in the configured path, 
it gets added as a file in pendingFile list and when operator tries to open it 
for reading
it fails, the operator keeps retrying for configured number of time and then 
ignore this file.

The fix would be to not return directory name in scanned file names in the 
first place.

This message was sent by Atlassian JIRA

Reply via email to