[
https://issues.apache.org/jira/browse/FLINK-13376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Piotr Nowojski closed FLINK-13376.
----------------------------------
Resolution: Fixed
Merged as 9a151d3bc1..c44914e547 to release-1.9
Merged as 3b06b1a4a25607c193388baf95b268f984517774 and
bd4328dbcea908191b669e53b57b790a4e627ecd to master
> FileInputFormat can not be used in batch mode of blink-planner
> --------------------------------------------------------------
>
> Key: FLINK-13376
> URL: https://issues.apache.org/jira/browse/FLINK-13376
> Project: Flink
> Issue Type: Sub-task
> Components: Connectors / FileSystem, Runtime / Task, Table SQL /
> Runtime
> Reporter: Jingsong Lee
> Assignee: Biao Liu
> Priority: Blocker
> Labels: pull-request-available
> Fix For: 1.9.0, 1.10.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> FileInputFormat use ContinuousFileReaderOperator in
> StreamExecutionEnvironment, and ContinuousFileReaderOperator join the async
> thread in close, So before closing, the data is incomplete.
> But batch operators use endInput to do some work, this lead to incomplete
> records in endInput, and lead to wrong results.
> This mean batch mode of blink-planner can not use file related sources...
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
