[
https://issues.apache.org/jira/browse/FLINK-19547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yuan Mei updated FLINK-19547:
-----------------------------
Description:
Partial records happen if a record can not fit into one buffer, then the
remaining part of the same record is put into the next buffer. Hence partial
records only exist at the beginning of a buffer.
Partial record clean-up is needed in the mode of approximate local recovery. If
a record is spanning over multiple buffers, and the first (several) buffers
have got lost due to the failure of the receiver task, the remaining data
belonging to the same record in transition should be cleaned up.
was:In the mode of approximate local recovery, the problem of partial record
occurs when a record is spanning over multiple buffers. If the first (several)
buffers have already been sent over the network and then get lost due to the
failure of the receiver task, the remaining data belonging to the same record
in transition should be cleaned up.
> Partial record clean up after receiver task fails and restart
> -------------------------------------------------------------
>
> Key: FLINK-19547
> URL: https://issues.apache.org/jira/browse/FLINK-19547
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Network
> Affects Versions: 1.12.0
> Reporter: Yuan Mei
> Priority: Major
>
> Partial records happen if a record can not fit into one buffer, then the
> remaining part of the same record is put into the next buffer. Hence partial
> records only exist at the beginning of a buffer.
> Partial record clean-up is needed in the mode of approximate local recovery.
> If a record is spanning over multiple buffers, and the first (several)
> buffers have got lost due to the failure of the receiver task, the remaining
> data belonging to the same record in transition should be cleaned up.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
