Tian Gao created SPARK-54340:
--------------------------------
Summary: Add a script to enable viztracer on daemon/workers for
python udf
Key: SPARK-54340
URL: https://issues.apache.org/jira/browse/SPARK-54340
Project: Spark
Issue Type: Improvement
Components: PySpark
Affects Versions: 4.1.0
Reporter: Tian Gao
We have very few clues about what's going on in Python daemon/workers that are
used for Python UDFs. We can add a simple wrapper script to profile/debug
Python UDFs and the infrastructure that supports it. We can do it without
touching the pyspark code.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
