[
https://issues.apache.org/jira/browse/FLINK-17593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aljoscha Krettek closed FLINK-17593.
------------------------------------
Resolution: Fixed
release-1.11: 4d684dfa1963ec976f8b22afe033fbef8548d2d0
master: 220f7dabf24fc1e6fe77b83a00a7de47d75d5b18
> Support arbitrary recovery mechanism for PartFileWriter
> -------------------------------------------------------
>
> Key: FLINK-17593
> URL: https://issues.apache.org/jira/browse/FLINK-17593
> Project: Flink
> Issue Type: Sub-task
> Components: Connectors / FileSystem
> Reporter: Yun Gao
> Assignee: Guowei Ma
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.11.0
>
>
> Currently Bucket relies directly on _RecoverableOutputStream_ provided by
> FileSystem to achieve snapshotting and recovery the in-progress part file for
> all the PartFileWriter implementations. This would require that the
> PartFileWriter must be based on the OutputStream.
> To support the path-based PartFileWriter required by the Hive Sink, we will
> first need to abstract the snapshotting mechanism of the PartFileWriter and
> make RecoverableOutputStream to be one type of implementation, thus we could
> decouple PartFileWriter with the output streams.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
