Github user ueshin commented on the issue:
https://github.com/apache/spark/pull/19840
Should we set the `pythonExec` during the initialization of `SparkContext`
at
[context.py#L191](https://github.com/yaooqinn/spark/blob/8ff5663fe9a32eae79c8ee6bc310409170a8da64/python/pyspark/context.py#L191)
instead of in `PythonRunner`? @jiangxb1987 @cloud-fan
Btw, just for confirmation, is `spark.yarn.appMasterEnv.PYSPARK_PYTHON`
working? @yaooqinn
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
