Mark Grover created SPARK-14711:
-----------------------------------
Summary: Examples jar not a part of distribution
Key: SPARK-14711
URL: https://issues.apache.org/jira/browse/SPARK-14711
Project: Spark
Issue Type: Bug
Components: Build
Affects Versions: 2.0.0
Reporter: Mark Grover
While mucking around with some examples, it seems like spark-examples jar is
not being included in the distribution tarball. Also, it's not in the classpath
in the spark-submit classpath, which means commands like {{run-example}} fail
to work, whether a "distribution" tarball is used or a regular {{mvn package}}
build.
The root cause of this may be due to the fact that the spark-examples jar is
under {{$SPARK_HOME/examples/target}} while all its dependencies are at
{{$SPARK_HOME/examples/target/scala-2.11/jars}}. And, we only seem to be
including the jars directory in the classpath. See
[here|https://github.com/apache/spark/blob/master/launcher/src/main/java/org/apache/spark/launcher/SparkSubmitCommandBuilder.java#L354]
for details.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
