Ziqi Liu created SPARK-49852:
--------------------------------
Summary: Fix deadlock between shuffle dependency initialization
and explain string generation
Key: SPARK-49852
URL: https://issues.apache.org/jira/browse/SPARK-49852
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 4.0.0
Reporter: Ziqi Liu
We hit a deadlock between shuffle dependency initialization and explain string
generation, in which both code paths trigger lazy variable instantiation while
visiting some tree nodes in different orders and thus acquiring object locks in
a reversed order.
The hashcode of plan node is implemented as lazy val. So the fix is to remove
hash code computation from explain string generation so to break the chain of
lazy variable instantiation.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
