[
https://issues.apache.org/jira/browse/FLINK-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14236681#comment-14236681
]
ASF GitHub Bot commented on FLINK-1081:
---------------------------------------
Github user gyfora commented on the pull request:
https://github.com/apache/incubator-flink/pull/226#issuecomment-65889528
I think this is a good way to do the file partitioning among the source
instances, I like it.
At least the partitioning logic is separate from the actual source
processing the files and we can change the components later easily.
The name FileMapFunction might be a little confusing. It sounds like a file
that actually maps the file contents to something else. I would probably leave
the name as it is for now (we can always change it later).
> Add HDFS file-stream source for streaming
> -----------------------------------------
>
> Key: FLINK-1081
> URL: https://issues.apache.org/jira/browse/FLINK-1081
> Project: Flink
> Issue Type: Improvement
> Components: Streaming
> Affects Versions: 0.7.0-incubating
> Reporter: Gyula Fora
> Assignee: Chiwan Park
> Labels: starter
>
> Add data stream source that will monitor a slected directory on HDFS (or
> other filesystems as well) and will process all new files created.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
