[
https://issues.apache.org/jira/browse/FLINK-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14227676#comment-14227676
]
ASF GitHub Bot commented on FLINK-1081:
---------------------------------------
Github user chiwanpark commented on the pull request:
https://github.com/apache/incubator-flink/pull/226#issuecomment-64793316
More changes in this PR.
1. Add getPos() method into FSDataInputStream class.
2. Implement getPos() method of LocalDataInputStream,
DistributedDataInputStream. (S3DataInputStream and
InflaterInputStreamFSInputWrapper don't support getPos() method.)
3. Add watching type parameter in readFileStream method and
FileStreamFunction. (See FileStreamFunction.WatchType)
4. Ignore files in currently copying (filename contain \_\_COPYING\_\_) and
hidden files (filename start with dot.)
> Add HDFS file-stream source for streaming
> -----------------------------------------
>
> Key: FLINK-1081
> URL: https://issues.apache.org/jira/browse/FLINK-1081
> Project: Flink
> Issue Type: Improvement
> Components: Streaming
> Affects Versions: 0.7.0-incubating
> Reporter: Gyula Fora
> Assignee: Chiwan Park
> Labels: starter
>
> Add data stream source that will monitor a slected directory on HDFS (or
> other filesystems as well) and will process all new files created.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
