[
https://issues.apache.org/jira/browse/FLINK-25591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fabian Paul updated FLINK-25591:
--------------------------------
Description:
Evaluate whether it is possible to replace the internals of
StreamExecutionEnvironment.readFile with the FileSource. The File Source also
misses some features i.e. nested file enumeration, filter files.
Unfortunately, the FileSource is not state compatible with the continuous file
reader operator so we might have to introduce a new method because we cannot
replace the existing one easily.
was:
Evaluate whether it is possible to replace the internals of
StreamExecutionEnvironment.readFile with the FileSource. The FileSource can
already read the state of the previous version but some functionality might be
missing i.e. nested file enumeration, filter files.
If the replacement is not possible we should add a new method based on the
FileSource and deprecate the old one.
> Use FileSource for StreamExecutionEnvironment.readFile
> ------------------------------------------------------
>
> Key: FLINK-25591
> URL: https://issues.apache.org/jira/browse/FLINK-25591
> Project: Flink
> Issue Type: New Feature
> Components: API / DataStream, Connectors / FileSystem
> Reporter: Fabian Paul
> Priority: Major
>
> Evaluate whether it is possible to replace the internals of
> StreamExecutionEnvironment.readFile with the FileSource. The File Source also
> misses some features i.e. nested file enumeration, filter files.
> Unfortunately, the FileSource is not state compatible with the continuous
> file reader operator so we might have to introduce a new method because we
> cannot replace the existing one easily.
>
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
