Dmitry created SPARK-51608:
------------------------------
Summary: Better log exception in python udf worker.
Key: SPARK-51608
URL: https://issues.apache.org/jira/browse/SPARK-51608
Project: Spark
Issue Type: Improvement
Components: PySpark
Affects Versions: 4.0.0
Reporter: Dmitry
It was possible to see the error in the logs:
{{24/12/27 20:25:04 WARN PythonUDFWithNamedArgumentsRunner: Failed to stop
worker}}
However, it does not reaveal what exactely happened. It really makes sense to
include exception information to the logs.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
