I'm attempting to use the Spark Kinesis Connector, so I've added the following
dependency in my build.sbt:
libraryDependencies += org.apache.spark %% spark-streaming-kinesis-asl %
1.3.0
My app works fine with sbt run, but I can't seem to get sbt assembly to
work without failing with different
If you are creating an assembly, make sure spark-streaming is marked as
provided. spark-streaming is already part of the spark installation so will
be present at run time. That might solve some of these, may be!?
TD
On Mon, Mar 16, 2015 at 11:30 AM, Kelly, Jonathan jonat...@amazon.com
wrote:
-streaming-kinesis-asl and sbt assembly
(different file contents found)
If you are creating an assembly, make sure spark-streaming is marked as
provided. spark-streaming is already part of the spark installation so will
be present at run time. That might solve some of these, may be!?
TD
On Mon
Kelly jonat...@amazon.commailto:jonat...@amazon.com
Cc: user@spark.apache.orgmailto:user@spark.apache.org
user@spark.apache.orgmailto:user@spark.apache.org
Subject: Re: problems with spark-streaming-kinesis-asl and sbt assembly
(different file contents found)
If you are creating an assembly, make
@spark.apache.orgmailto:user@spark.apache.org
Subject: Re: problems with spark-streaming-kinesis-asl and sbt assembly
(different file contents found)
Can you give use your SBT project? Minus the source codes if you don't wish to
expose them.
TD
On Mon, Mar 16, 2015 at 12:54 PM, Kelly, Jonathan
jonat
