[
https://issues.apache.org/jira/browse/FLINK-21951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yingjie Cao updated FLINK-21951:
--------------------------------
Description: The wrong if condition in BufferReaderWriterUtil#writeBuffers
may lead to data loss when bulk writing a large number of buffers into file.
This is a bug intruded since 1.9, but only small amount of data is written, so
the bug never occurs. In 1.13, the sort-merge shuffle uses it to write more
data which triggers the bug. (was: The wrong if condition in
BufferReaderWriterUtil#writeBuffers may lead to data loss when bulk writing a
large amount of data into file. This is a bug intruded since 1.9, but only
small amount of data is written, so the bug never occurs. In 1.13, the
sort-merge shuffle uses it to write more data which triggers the bug.)
> Fix wrong if condition in BufferReaderWriterUtil#writeBuffers
> -------------------------------------------------------------
>
> Key: FLINK-21951
> URL: https://issues.apache.org/jira/browse/FLINK-21951
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Network
> Reporter: Yingjie Cao
> Priority: Major
> Fix For: 1.13.0
>
>
> The wrong if condition in BufferReaderWriterUtil#writeBuffers may lead to
> data loss when bulk writing a large number of buffers into file. This is a
> bug intruded since 1.9, but only small amount of data is written, so the bug
> never occurs. In 1.13, the sort-merge shuffle uses it to write more data
> which triggers the bug.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
