Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/22340
- Since `runSparkSubmit` is a part of `SparkSubmitTestUtils`, some test
case will fail if we always remove the env variables like
`SPARK_DIST_CLASSPATH`. It gives the child the correct test-time class-path.
- For executing old Spark distribution, yes. `SPARK_DIST_CLASSPATH` was the
direct root cause and `SPARK_PREPEND_CLASSES` also doesn't look safe to me. I
added the others in order to be proactively preventive.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
