Yingjie Cao created FLINK-15166:
-----------------------------------

             Summary: Shuffle data compression wrongly decrease the buffer 
reference count.
                 Key: FLINK-15166
                 URL: https://issues.apache.org/jira/browse/FLINK-15166
             Project: Flink
          Issue Type: Bug
          Components: Runtime / Network
    Affects Versions: 1.10.0
            Reporter: Yingjie Cao
             Fix For: 1.10.0


FLINK-15140 report two relevant problems which are both triggered by broadcast 
partitioner, to make it more clear, I create this Jira to addresses the 
problems separately.

 

For blocking shuffle compression, we recycle the compressed intermediate buffer 
each time after we write data out, however when the data is not compressed, the 
return buffer is the original buffer and should not be recycled, but we wrongly 
recycled it.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to