[
https://issues.apache.org/jira/browse/FLINK-15166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhijiang resolved FLINK-15166.
------------------------------
Resolution: Fixed
Fixed in master : 4d693c4fbc5e6f3ff34ccb3cb3a1d9f35d6bbd76
> Shuffle data compression wrongly decrease the buffer reference count.
> ---------------------------------------------------------------------
>
> Key: FLINK-15166
> URL: https://issues.apache.org/jira/browse/FLINK-15166
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Network
> Affects Versions: 1.10.0
> Reporter: Yingjie Cao
> Assignee: Yingjie Cao
> Priority: Blocker
> Labels: pull-request-available
> Fix For: 1.10.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> FLINK-15140 report two relevant problems which are both triggered by
> broadcast partitioner, to make it more clear, I create this Jira to addresses
> the problems separately.
>
> For blocking shuffle compression, we recycle the compressed intermediate
> buffer each time after we write data out, however when the data is not
> compressed, the return buffer is the original buffer and should not be
> recycled, but we wrongly recycled it.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
