Tian Gao created SPARK-55663:
--------------------------------
Summary: Unify __module__ for data source function/modules for
profiler
Key: SPARK-55663
URL: https://issues.apache.org/jira/browse/SPARK-55663
Project: Spark
Issue Type: Bug
Components: PySpark
Affects Versions: 4.2.0
Reporter: Tian Gao
When using simple worker, __module__ of each data source worker function will
be `__main__` and it confuses the profiler sometime.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]