Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/19840
I'm a little concerned about such changes, this may be misconfigured to
introduce the discrepancy between driver python and executor python, at least
we should honor this configuration "spark.executorEnv.PYSPARK_PYTHON" unless
the executables of `PYSPARK_PYTHON` sent by driver is not existed. (Just my two
cents)
ping @zjffdu , any thought?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
