[
https://issues.apache.org/jira/browse/FLINK-28602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hangxiang Yu updated FLINK-28602:
---------------------------------
Description:
While enabling compression, Changelog part will wrap output stream using
StreamCompressionDecorator#decorateWithCompression.
As the comment said, "IMPORTANT: For streams returned by this method, \{@link
OutputStream#close()} is not propagated to the inner stream. The inner stream
must be closed separately.".
But StateChangeFsUploader will not close inner stream if wrapped stream has
been closed.
So the upload may not complete when enabling compression even if it returns
success.
was:
While enabling compression, Changelog part will wrap output stream using
StreamCompressionDecorator#decorateWithCompression.
As the comment said, "IMPORTANT: For streams returned by this method, \{@link
OutputStream#close()} is not propagated to the inner stream. The inner stream
must be closed separately.".
But StateChangeFsUploader will not close inner stream if wrapped stream has
been closed.
So the upload will not complete when enabling compression even if it returns
success.
> Changelog cannot close stream normally while enabling compression
> -----------------------------------------------------------------
>
> Key: FLINK-28602
> URL: https://issues.apache.org/jira/browse/FLINK-28602
> Project: Flink
> Issue Type: Bug
> Components: Runtime / State Backends
> Affects Versions: 1.15.1, 1.16.0
> Reporter: Hangxiang Yu
> Priority: Major
> Fix For: 1.16.0, 1.15.2
>
>
> While enabling compression, Changelog part will wrap output stream using
> StreamCompressionDecorator#decorateWithCompression.
> As the comment said, "IMPORTANT: For streams returned by this method, \{@link
> OutputStream#close()} is not propagated to the inner stream. The inner stream
> must be closed separately.".
> But StateChangeFsUploader will not close inner stream if wrapped stream has
> been closed.
> So the upload may not complete when enabling compression even if it returns
> success.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
