[
https://issues.apache.org/jira/browse/FLINK-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17061043#comment-17061043
]
Vasii Cosmin Radu commented on FLINK-11794:
-------------------------------------------
I think the ticket is referring to compression in the case of a row format, not
the bulk one. "Encoder" is mentioned.
Is there any way to achieve this [~eskabetxe] ?
[~elevy] I see you opened this ticket quite some time ago. Did you manage to
find a solution?
> Allow compression of row format files created by StreamingFileSink
> ------------------------------------------------------------------
>
> Key: FLINK-11794
> URL: https://issues.apache.org/jira/browse/FLINK-11794
> Project: Flink
> Issue Type: Improvement
> Components: Connectors / FileSystem
> Affects Versions: 1.7.2
> Reporter: Elias Levy
> Priority: Major
>
> Currently, there is no mechanism to compress files created using a
> StreamingFileSink. This is highly desirable when output is a text based row
> format such as JSON.
> Possible alternatives are the introduction of a callback that gets passed the
> local file before it is uploaded to the DFS, so that it could be compressed;
> or a factory method could be used that returns an OutputStream, such as
> GZIPOutputStream, that compresses a passed in output stream that could be
> then used by the Encoder.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
