[
https://issues.apache.org/jira/browse/FLINK-5432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15816697#comment-15816697
]
ASF GitHub Bot commented on FLINK-5432:
---------------------------------------
GitHub user ymarzougui opened a pull request:
https://github.com/apache/flink/pull/3090
[FLINK-5432] fix nested files enumeration in
ContinuousFileMonitoringFunction
This PR fixes reading nested files when the InputFormat has
NestedFileEnumeration set to true. Nested files were not read because the code
in listEligibleFiles did not recursively enumerate the input paths.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ymarzougui/flink FLINK-5432
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/3090.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3090
----
commit c74996b278187e348af7043ddc0aa9a500373502
Author: Yassine Marzougui <[email protected]>
Date: 2017-01-11T00:43:19Z
[FLINK-5432] recursively scan nested files in
ContinuousFileMonitoringFunction
----
> ContinuousFileMonitoringFunction is not monitoring nested files
> ---------------------------------------------------------------
>
> Key: FLINK-5432
> URL: https://issues.apache.org/jira/browse/FLINK-5432
> Project: Flink
> Issue Type: Bug
> Components: filesystem-connector
> Affects Versions: 1.2.0
> Reporter: Yassine Marzougui
> Assignee: Yassine Marzougui
>
> The {{ContinuousFileMonitoringFunction}} does not monitor nested files even
> if the inputformat has NestedFileEnumeration set to true. This can be fixed
> by enabling a recursive scan of the directories in the {{listEligibleFiles}}
> method.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
