[
https://issues.apache.org/jira/browse/BIGTOP-1415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Manikandan Narayanaswamy updated BIGTOP-1415:
---------------------------------------------
Description:
Looking at the current parcel version of Spark, it packages a lot of things
that are not necessary, and is missing some others that might be useful.
bagel/lib/spark-bagel_2.10-1.0.0-*.jar
core/lib/spark-core_2.10-1.0.0-*.jar
lib/*
mllib/lib/spark-mllib_2.10-1.0.0-*.jar
repl/lib/spark-repl_2.10-1.0.0-*.jar
streaming/lib/spark-streaming_2.10-1.0.0-*.jar
None of the above are necessary, since they are already packaged in
assembly/lib/spark-assembly-1.0.0-*.jar, which is what everybody should be
using.
examples/lib/spark-examples_2.10-1.0.0-*-javadoc.jar
examples/lib/spark-examples_2.10-1.0.0-*-sources.jar
Again not necessary, just because, well, anyone who needs that can use maven.
was:
But looking at the current parcel version of Spark, it packages a lot of things
that are not necessary, and is missing some others that might be useful.
bagel/lib/spark-bagel_2.10-1.0.0-*.jar
core/lib/spark-core_2.10-1.0.0-*.jar
lib/*
mllib/lib/spark-mllib_2.10-1.0.0-*.jar
repl/lib/spark-repl_2.10-1.0.0-*.jar
streaming/lib/spark-streaming_2.10-1.0.0-*.jar
None of the above are necessary, since they are already packaged in
assembly/lib/spark-assembly-1.0.0-*.jar, which is what everybody should be
using.
examples/lib/spark-examples_2.10-1.0.0-*-javadoc.jar
examples/lib/spark-examples_2.10-1.0.0-*-sources.jar
Again not necessary, just because, well, anyone who needs that can use maven.
> Remove redundant jars from spark package.
> -----------------------------------------
>
> Key: BIGTOP-1415
> URL: https://issues.apache.org/jira/browse/BIGTOP-1415
> Project: Bigtop
> Issue Type: Bug
> Components: spark
> Affects Versions: 0.7.0
> Reporter: Manikandan Narayanaswamy
>
> Looking at the current parcel version of Spark, it packages a lot of things
> that are not necessary, and is missing some others that might be useful.
> bagel/lib/spark-bagel_2.10-1.0.0-*.jar
> core/lib/spark-core_2.10-1.0.0-*.jar
> lib/*
> mllib/lib/spark-mllib_2.10-1.0.0-*.jar
> repl/lib/spark-repl_2.10-1.0.0-*.jar
> streaming/lib/spark-streaming_2.10-1.0.0-*.jar
> None of the above are necessary, since they are already packaged in
> assembly/lib/spark-assembly-1.0.0-*.jar, which is what everybody should be
> using.
> examples/lib/spark-examples_2.10-1.0.0-*-javadoc.jar
> examples/lib/spark-examples_2.10-1.0.0-*-sources.jar
> Again not necessary, just because, well, anyone who needs that can use maven.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
