Re: looking for Spark streaming unit example written in Java

2015-12-17 Thread Andy Davidson
') testCompile files(sparkCoreTestJar) } From: Andrew Davidson <a...@santacruzintegration.com> Date: Wednesday, December 16, 2015 at 5:37 PM To: Ted Yu <yuzhih...@gmail.com> Cc: "user @spark" <user@spark.apache.org> Subject: Re: looking for Spark streaming unit examp

looking for Spark streaming unit example written in Java

2015-12-15 Thread Andy Davidson
I am having a heck of a time writing a simple Junit test for my spark streaming code. The best code example I have been able to find is http://mkuthan.github.io/blog/2015/03/01/spark-unit-testing/ unfortunately it is written in Spock and Scala. I am having trouble figuring out how to get it to

Re: looking for Spark streaming unit example written in Java

2015-12-15 Thread Ted Yu
Have you taken a look at streaming/src/test//java/org/apache/spark/streaming/JavaAPISuite.java ? JavaDStream stream = ssc.queueStream(rdds); JavaTestUtils.attachTestOutputStream(stream); FYI On Tue, Dec 15, 2015 at 6:36 PM, Andy Davidson < a...@santacruzintegration.com> wrote: > I am