Tian Gao created SPARK-54740:
--------------------------------
Summary: Start faulthandler early in daemon mode
Key: SPARK-54740
URL: https://issues.apache.org/jira/browse/SPARK-54740
Project: Spark
Issue Type: Improvement
Components: PySpark
Affects Versions: 4.2.0
Reporter: Tian Gao
It's possible that our worker process has issues before the worker main
function executes - but faulthandler is not attached so we can't really do
anything about it. We hook faulthandler on the worker main function because
that's the common path for daemon and simple mode. However, we can make the
faulthandler helper reentry friendly so we can start it early in daemon mode
without changing the simple mode code.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
