[
https://issues.apache.org/jira/browse/FLINK-29238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xintong Song closed FLINK-29238.
--------------------------------
Resolution: Fixed
- master (1.17): 12dfe6abd66646c7473bbe353d7b5eb0cfd41130
- release-1.16: 438eddefbf13efa604a6bb8c3b0d3e0e10d741ce
> Wrong index information will be obtained after the downstream failover in
> hybrid full mode
> ------------------------------------------------------------------------------------------
>
> Key: FLINK-29238
> URL: https://issues.apache.org/jira/browse/FLINK-29238
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Network
> Affects Versions: 1.16.0
> Reporter: Weijie Guo
> Assignee: Weijie Guo
> Priority: Blocker
> Labels: pull-request-available
> Fix For: 1.16.0
>
>
> Hybrid shuffle relies on the index to read the disk data. Since the spilled
> data may be consumed from memory, the readable status is introduced. For the
> readable buffer, FileDataManager does not pre-load it. However, when the
> downstream fails, the previous readable status will be used incorrectly,
> resulting in that some buffer cannot be read correctly.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
