[
https://issues.apache.org/jira/browse/FLINK-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238105#comment-14238105
]
Robert Metzger commented on FLINK-1307:
---------------------------------------
I think a config param is the right way to do it.
The DataSource class has a method "withParameters()" which allows to pass any
configuration value. If we document it properly, that would be sufficient.
If we think that people are going to use the feature frequently, we can either
add a separate method, or another method signature:
{code}
public DataSource<String> readTextFile(String filePath, boolean recursive)
{code}
I think extending the file stats is a good idea, otherwise the size estimates
could be off.
> Allow input from nested directory structure
> -------------------------------------------
>
> Key: FLINK-1307
> URL: https://issues.apache.org/jira/browse/FLINK-1307
> Project: Flink
> Issue Type: New Feature
> Reporter: Vasia Kalavri
> Assignee: Vasia Kalavri
> Priority: Minor
> Labels: easyfix, features
>
> Currently it is not possible to read input from nested directories. When
> given a directory as input path, only the top-level files are considered.
> This issue proposes to add support for recursively enumerating nested files
> in FileInputFormat.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
