[ https://issues.apache.org/jira/browse/FLINK-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16360838#comment-16360838 ]
ASF GitHub Bot commented on FLINK-3655: --------------------------------------- Github user zentol commented on the issue: https://github.com/apache/flink/pull/5415 What would speak against creating a new FileInputFormat that supports multiple paths instead? Common code could be moved into a shared super class (I _think_ that would be allowed). > Allow comma-separated or multiple directories to be specified for > FileInputFormat > --------------------------------------------------------------------------------- > > Key: FLINK-3655 > URL: https://issues.apache.org/jira/browse/FLINK-3655 > Project: Flink > Issue Type: Improvement > Components: Core > Affects Versions: 1.0.0 > Reporter: Gna Phetsarath > Assignee: Fabian Hueske > Priority: Major > Labels: starter > Fix For: 1.5.0 > > > Allow comma-separated or multiple directories to be specified for > FileInputFormat so that a DataSource will process the directories > sequentially. > > env.readFile("/data/2016/01/01/*/*,/data/2016/01/02/*/*,/data/2016/01/03/*/*") > in Scala > env.readFile(paths: Seq[String]) > or > env.readFile(path: String, otherPaths: String*) > Wildcard support would be a bonus. -- This message was sent by Atlassian JIRA (v7.6.3#76005)