Tian Gao created SPARK-54615:
--------------------------------
Summary: Always pass runner_conf to python worker
Key: SPARK-54615
URL: https://issues.apache.org/jira/browse/SPARK-54615
Project: Spark
Issue Type: Sub-task
Components: PySpark
Affects Versions: 4.2.0
Reporter: Tian Gao
Currently we pass runnerConf in different ways with different variable names.
runnerConf itself has been proven useful to pass the configuration from JVM to
python workers. We can just always pass it. When it's not needed, it almost
costs nothing. The code will be cleaner and we can gradually move some
arguments to runnerConf.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
