[
https://issues.apache.org/jira/browse/FLINK-9545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bowen Li updated FLINK-9545:
----------------------------
Description:
Motivation: We have the requirements to read a bunch files, each file to read
multiple times, to feed our streams
Specifically we need {{StreamExecutionEnvironment.readFile/readTextFile}} to be
able to read a file for a specified {{N}} times, but currently it only supports
reading file once.
We've implemented this internally. Would be good to get it back to the
community version. This jira is to add support for the feature.
Plan:
add a new processing mode as PROCESSING_N_TIMES, and add additional parameter
{{numTimes}} for {{StreamExecutionEnvironment.readFile/readTextFile}}
was:
Motivation: We have the requirements to read a bunch files, each file to read
multiple times, to feed our streams
Specifically we need {{StreamExecutionEnvironment.readFile/readTextFile}} to be
able to read a file for a specified {{N}} times, but currently it only supports
reading file once.
We've implemented this internally. Would be good to back it back to the
community version.
Feature: add support for the feature.
Plan:
add a new processing mode as PROCESSING_N_TIMES, and add additional parameter
{{numTimes}} for {{StreamExecutionEnvironment.readFile/readTextFile}}
> Support read a file multiple times in Flink DataStream
> -------------------------------------------------------
>
> Key: FLINK-9545
> URL: https://issues.apache.org/jira/browse/FLINK-9545
> Project: Flink
> Issue Type: Improvement
> Components: DataStream API
> Affects Versions: 1.6.0
> Reporter: Bowen Li
> Assignee: Bowen Li
> Priority: Major
> Fix For: 1.6.0
>
>
> Motivation: We have the requirements to read a bunch files, each file to read
> multiple times, to feed our streams
> Specifically we need {{StreamExecutionEnvironment.readFile/readTextFile}} to
> be able to read a file for a specified {{N}} times, but currently it only
> supports reading file once.
> We've implemented this internally. Would be good to get it back to the
> community version. This jira is to add support for the feature.
> Plan:
> add a new processing mode as PROCESSING_N_TIMES, and add additional parameter
> {{numTimes}} for {{StreamExecutionEnvironment.readFile/readTextFile}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
