dongjoon-hyun commented on a change in pull request #29241:
URL: https://github.com/apache/spark/pull/29241#discussion_r460569961
##########
File path:
sql/core/src/test/scala/org/apache/spark/sql/execution/python/PythonUDFSuite.scala
##########
@@ -28,6 +28,8 @@ class PythonUDFSuite extends QueryTest with
SharedSparkSession {
val scalaTestUDF = TestScalaUDF(name = "scalaUDF")
val pythonTestUDF = TestPythonUDF(name = "pyUDF")
+ assume(pythonExec.equals("python3"))
Review comment:
Technically, we hit the similar issue before at SPARK-32422 two days
ago. cc @HyukjinKwon .
```
[SPARK-32422][SQL][TESTS] Use python3 executable instead of python3.6 in
IntegratedUDFTestUtils
```
```scala
lazy val pythonExec: String = {
val pythonExec = sys.env.getOrElse(
"PYSPARK_DRIVER_PYTHON", sys.env.getOrElse("PYSPARK_PYTHON",
"python3"))
if (TestUtils.testCommandAvailable(pythonExec)) {
pythonExec
} else {
"python"
}
}
```
At SPARK-32422, `python3.6` doesn't work correctly and @HyukjinKwon replaced
it from `python3.6` to `python3`. The root cause is that we have multiple
Python installation environment.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
