sunchao commented on pull request #29843: URL: https://github.com/apache/spark/pull/29843#issuecomment-698402391
Hmm interesting. There is still one Python test in YARN failing with: ``` Exception: Python in worker has different version 3.6 than that in driver 3.8, PySpark cannot run with different minor versions. Please check environment variables PYSPARK_PYTHON and PYSPARK_DRIVER_PYTHON are correctly set. ``` after I changed `YarnClusterSuite` to use python3. Seems we've already specified to use 3.8 in the [CI config](https://github.com/apache/spark/blob/master/.github/workflows/build_and_test.yml#L150), so not sure why that happens. @HyukjinKwon any hint? Thanks. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
