SPARK_HADOOP_VERSION=2.3.0 sbt/sbt assembly
and copy the generated jar to lib/ directory of my application,
it seems that sbt cannot find the dependencies in the jar?
but everything works with the pre-built jar files downloaded from the link
provided by Patrick
Best,
--
Nan Zhu
On
: d636772 (v1.0.0-rc3)
https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=d636772ea9f98e449a038567b7975b1a07de3221
Binaries:
http://people.apache.org/~pwendell/spark-1.0.0-rc3/
Docs:
http://people.apache.org/~pwendell/spark-1.0.0-rc3-docs/
Repository:
https
I'm guessing EC2 support is not there yet?
I was able to build using the binary download on both Windows 7 and RHEL 6
without issues.
I tried to create an EC2 cluster, but saw this:
~/spark-ec2
Initializing spark
~ ~/spark-ec2
ERROR: Unknown Spark version
Initializing shark
~ ~/spark-ec2
-mail
to the Spark dev list and/or file a JIRA.
Commit: d636772 (v1.0.0-rc3)
https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=d636772ea9f98e449a038567b7975b1a07de3221
Binaries:
http://people.apache.org/~pwendell/spark-1.0.0-rc3/
Docs:
http://people.apache.org/~pwendell/spark-1.0.0-rc3
=d636772ea9f98e449a038567b7975b1a07de3221
Binaries:
http://people.apache.org/~pwendell/spark-1.0.0-rc3/
Docs:
http://people.apache.org/~pwendell/spark-1.0.0-rc3-docs/
Repository:
https://repository.apache.org/content/repositories/orgapachespark-1012/
== API Changes ==
If you want to test building against Spark
What are the expectations / guarantees on binary compatibility between
0.9 and 1.0?
There are not guarantees.
-us.apache.org/repos/asf?p=spark.git;a=commit;h=d636772ea9f98e449a038567b7975b1a07de3221
Binaries:
http://people.apache.org/~pwendell/spark-1.0.0-rc3/
Docs:
http://people.apache.org/~pwendell/spark-1.0.0-rc3-docs/
Repository:
https://repository.apache.org/content/repositories/orgapachespark
to the Spark dev list and/or file a JIRA.
Commit: d636772 (v1.0.0-rc3)
https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=d636772ea9f98e449a038567b7975b1a07de3221
Binaries:
http://people.apache.org/~pwendell/spark-1.0.0-rc3/
Docs:
http://people.apache.org/~pwendell
:
http://people.apache.org/~pwendell/spark-1.0.0-rc3/
Docs:
http://people.apache.org/~pwendell/spark-1.0.0-rc3-docs/
Repository:
https://repository.apache.org/content/repositories/orgapachespark-1012/
== API Changes ==
If you want to test building against Spark there are some minor