[
https://issues.apache.org/jira/browse/SPARK-50620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fei Wang resolved SPARK-50620.
------------------------------
Resolution: Not A Problem
The issue has gone since 3.5.1, will check the patch in 3.5.1
> Dead lock caused by SQLConf$ and SqlApiConf initialization
> ----------------------------------------------------------
>
> Key: SPARK-50620
> URL: https://issues.apache.org/jira/browse/SPARK-50620
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.5.0
> Reporter: Fei Wang
> Priority: Major
> Labels: pull-request-available
> Attachments: iceberg_compaction.txt
>
>
> {code:java}
> "Executor 92 task launch worker for task 2910, task 69.0 in stage 7.0 (TID
> 2910)" #152 daemon prio=5 os_prio=0 cpu=616.25ms elapsed=258408.34s
> tid=0x00007f77d67cc330 nid=0x22c9e in Object.wait() [0x00007f77755fb000]
> java.lang.Thread.State: RUNNABLE
> at org.apache.spark.sql.internal.SQLConf$.<init>(SQLConf.scala:184)
> - waiting on the Class initialization monitor for
> org.apache.spark.sql.internal.SqlApiConf$
> at org.apache.spark.sql.internal.SQLConf$.<clinit>(SQLConf.scala) {code}
>
>
> {code:java}
> "Executor 92 task launch worker for task 5362, task 521.0 in stage 10.0 (TID
> 5362)" #123 daemon prio=5 os_prio=0 cpu=2443.78ms elapsed=258409.29s
> tid=0x00007f77d60ecad0 nid=0x22c7c in Object.wait() [0x00007f777e591000]
> java.lang.Thread.State: RUNNABLE
> at java.lang.Class.forName0([email protected]/Native Method)
> - waiting on the Class initialization monitor for
> org.apache.spark.sql.internal.SQLConf$
> at java.lang.Class.forName([email protected]/Class.java:467)
> at
> org.apache.spark.util.SparkClassUtils.classForName(SparkClassUtils.scala:41)
> at
> org.apache.spark.util.SparkClassUtils.classForName$(SparkClassUtils.scala:36)
> at
> org.apache.spark.util.SparkClassUtils$.classForName(SparkClassUtils.scala:83)
> at
> org.apache.spark.sql.internal.SqlApiConf$.$anonfun$new$1(SqlApiConf.scala:73)
> {code}
>
> For the first one:
> {{at org.apache.spark.sql.internal.SQLConf$.<clinit>(SQLConf.scala)}} {{-
> waiting on the Class initialization monitor for
> org.apache.spark.sql.internal.SqlApiConf$}}
> {{For the second one.}}
> {{at
> org.apache.spark.sql.internal.SqlApiConf$.$anonfun$new$1(SqlApiConf.scala:73)}}
> {{- waiting on the Class initialization monitor for
> org.apache.spark.sql.internal.SQLConf$}}
>
>
> See full thread dump in the attachment [^iceberg_compaction.txt]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
