[GitHub] spark pull request #23009: SPARK-26011: pyspark app with "spark.jars.package...

2018-11-12 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/23009#discussion_r232921575 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -318,7 +318,7 @@ private[spark] class SparkSubmit extends Logging {

[GitHub] spark pull request #23009: SPARK-26011: pyspark app with "spark.jars.package...

2018-11-12 Thread shanyu
Github user shanyu commented on a diff in the pull request: https://github.com/apache/spark/pull/23009#discussion_r232868311 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -318,7 +318,7 @@ private[spark] class SparkSubmit extends Logging {

[GitHub] spark pull request #23009: SPARK-26011: pyspark app with "spark.jars.package...

2018-11-12 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/23009#discussion_r232706315 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala --- @@ -318,7 +318,7 @@ private[spark] class SparkSubmit extends Logging {

[GitHub] spark pull request #23009: SPARK-26011: pyspark app with "spark.jars.package...

2018-11-11 Thread shanyu
GitHub user shanyu opened a pull request: https://github.com/apache/spark/pull/23009 SPARK-26011: pyspark app with "spark.jars.packages" config does not work SparkSubmit determines pyspark app by the suffix of primary resource but Livy uses "spark-internal" as the primary