[
https://issues.apache.org/jira/browse/FLINK-10114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17054920#comment-17054920
]
Yun Gao edited comment on FLINK-10114 at 3/9/20, 1:01 PM:
----------------------------------------------------------
It seems currently _{{StreamingFileSink}}_ indeed requires the writer to be
able to write to an {{_OutputStream_}} so that it could work with the recovery
mechanism, but official ORC library does not support it.
To overcome this problem, one option is to modify the current
StreamingFileSink, but it seems to be a bit complex. There might be another
option that seems to be simpler is that we might use
[presto-orc|[https://github.com/prestodb/presto/tree/master/presto-orc]]
directly, which enables writing to OutputStream. We could add a new shaded
module to hide the dependency on presto-orc.
was (Author: gaoyunhaii):
It seems currently _{{StreamingFileSink}}_ requires the writer to be able to
write to an {{_OutputStream_}} so that it could work with the recovery
mechanism, but official ORC library does not support it.
To overcome this problem, one option is to modify the current
StreamingFileSink, but it is a bit complex. Another simpler option is that we
might use
[presto-orc|[https://github.com/prestodb/presto/tree/master/presto-orc]], which
enables writing to OutputStream. We could add a new shaded module to hide the
dependency on presto-orc.
> Support Orc for StreamingFileSink
> ---------------------------------
>
> Key: FLINK-10114
> URL: https://issues.apache.org/jira/browse/FLINK-10114
> Project: Flink
> Issue Type: Sub-task
> Components: Connectors / FileSystem
> Reporter: zhangminglei
> Assignee: vinoyang
> Priority: Major
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
