Re: How can I compile only the core and streaming (so that I can get test utilities of streaming)?

I don't think 'sbt assembly' would touch local maven repo for Spark. Looking at dependency:tree output: [INFO] org.apache.spark:spark-streaming_2.10:jar:1.1.0-SNAPSHOT [INFO] +- org.apache.spark:spark-core_2.10:jar:1.1.0-SNAPSHOT:compile spark-streaming only depends on spark-core other than thir

Re: How can I compile only the core and streaming (so that I can get test utilities of streaming)?

Hello, Specifying '-DskipTests' on commandline worked, though I can't be sure whether first running 'sbt assembly' also contributed to the solution. (I've tried 'sbt assembly' because branch-1.1's README says to use sbt). Thanks for the answer. Kind regards, Emre Sevinç

Re: How can I compile only the core and streaming (so that I can get test utilities of streaming)?

Please specify '-DskipTests' on commandline. Cheers On Dec 5, 2014, at 3:52 AM, Emre Sevinc wrote: > Hello, > > I'm currently developing a Spark Streaming application and trying to write my > first unit test. I've used Java for this application, and I also need use > Java (and JUnit) for wr

How can I compile only the core and streaming (so that I can get test utilities of streaming)?

Hello, I'm currently developing a Spark Streaming application and trying to write my first unit test. I've used Java for this application, and I also need use Java (and JUnit) for writing unit tests. I could not find any documentation that focuses on Spark Streaming unit testing, all I could find