[
https://issues.apache.org/jira/browse/FLINK-21728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17301166#comment-17301166
]
Kezhu Wang commented on FLINK-21728:
------------------------------------
After hundred rounds in my local environment, I run into several paths for
concurrent free in {{BatchTask}} and {{ExternalTask}}:
# Concurrent free between {{memoryManager.releaseAll(invokable)}} in
{{Task.doRun}} and {{closeLocalStrategiesAndCaches}} in {{BatchTask.cancel}}.
# Concurrent free between {{memoryManager.releaseAll(invokable)}} in
{{Task.doRun}} and {{ExternalSorter.close}} caused by iterator exception. I
think this happens due to short-circuit {{closed}} checking.
I guess concurrent free between {{ExternalSorter.close}} and
{{SpillingThread.disposeSortBuffers}} is also possible if {{readThread}} or
{{sortThread}} fails before {{spillThread}}. I did not run into this situation.
cc [~dwysakowicz]
> DegreesWithExceptionITCase crash
> --------------------------------
>
> Key: FLINK-21728
> URL: https://issues.apache.org/jira/browse/FLINK-21728
> Project: Flink
> Issue Type: Bug
> Components: Library / Graph Processing (Gelly)
> Affects Versions: 1.13.0
> Reporter: Guowei Ma
> Assignee: Xintong Song
> Priority: Blocker
> Labels: pull-request-available, test-stability
> Fix For: 1.13.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=14422&view=logs&j=ce8f3cc3-c1ea-5281-f5eb-df9ebd24947f&t=f266c805-9429-58ed-2f9e-482e7b82f58b
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
