Tian Gao created SPARK-54724:
--------------------------------
Summary: Dump coverage data on worker before sending exception
Key: SPARK-54724
URL: https://issues.apache.org/jira/browse/SPARK-54724
Project: Spark
Issue Type: Improvement
Components: PySpark
Affects Versions: 4.2.0
Reporter: Tian Gao
The existing coverage infra often misses coverage on exceptions because it
sends the exception to JVM before dumping coverage data. JVM tries to kill the
worker when it knows the worker has raised an exception. We should dump the
coverage data before sending the exception.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
