[
https://issues.apache.org/jira/browse/FLINK-17593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17814195#comment-17814195
]
xiaogang zhou commented on FLINK-17593:
---------------------------------------
[~maguowei] Hi , for filesystem which does not support recoverable writer(like
oss filesystem), looks like we can not use the filesystem connector?
> Support arbitrary recovery mechanism for PartFileWriter
> -------------------------------------------------------
>
> Key: FLINK-17593
> URL: https://issues.apache.org/jira/browse/FLINK-17593
> Project: Flink
> Issue Type: Sub-task
> Components: Connectors / FileSystem
> Reporter: Yun Gao
> Assignee: Guowei Ma
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.11.0
>
>
> Currently Bucket relies directly on _RecoverableOutputStream_ provided by
> FileSystem to achieve snapshotting and recovery the in-progress part file for
> all the PartFileWriter implementations. This would require that the
> PartFileWriter must be based on the OutputStream.
> To support the path-based PartFileWriter required by the Hive Sink, we will
> first need to abstract the snapshotting mechanism of the PartFileWriter and
> make RecoverableOutputStream to be one type of implementation, thus we could
> decouple PartFileWriter with the output streams.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
