Weijie Guo created FLINK-28785:
----------------------------------
Summary: Hybrid shuffle consumer thread and upstream thread may
have dead lock
Key: FLINK-28785
URL: https://issues.apache.org/jira/browse/FLINK-28785
Project: Flink
Issue Type: Bug
Components: Runtime / Network
Reporter: Weijie Guo
Fix For: 1.16.0
In hybrid shuffle mode, subpartition view lock will be acquired by consumer
thread, and further acquire the read lock of MemoryDataManager. But
MemoryDataManager may acquire write lock to make a global spilling decision,
and then wait subpartition view lock to get consuming offset. In this case,
deadlock will occurs.
consumer thread : acqurie subpartition lock -> wait read lock.
upstream thread: acquire write lock -> wait subpartition lock.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
