dongjoon-hyun commented on a change in pull request #34138:
URL: https://github.com/apache/spark/pull/34138#discussion_r718238895
##########
File path: .github/workflows/build_and_test.yml
##########
@@ -391,8 +391,9 @@ jobs:
LC_ALL: C.UTF-8
LANG: C.UTF-8
PYSPARK_DRIVER_PYTHON: python3.9
+ PYSPARK_PYTHON: python3.9
Review comment:
This aims to prevent the following error currently happening on this PR.
```
RuntimeError: Python in worker has different version 3.8 than that in driver
3.9, PySpark cannot run with different minor versions. Please check environment
variables PYSPARK_PYTHON and PYSPARK_DRIVER_PYTHON are correctly set.
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
