Thanks. Spark-testing-base works pretty well.
On Fri, Jul 10, 2015 at 3:23 PM, Burak Yavuz brk...@gmail.com wrote:
I can +1 Holden's spark-testing-base package.
Burak
On Fri, Jul 10, 2015 at 12:23 PM, Holden Karau hol...@pigscanfly.ca
wrote:
Somewhat biased of course, but you can also
Hi,
I want to write junit test cases in scala for testing spark application. Is
there any guide or link which I can refer.
Thank you very much.
-Naveen
Unless you had something specific in mind, it should be as simple as
creating a SparkContext object using a master of local[2] in your tests
On Fri, Jul 10, 2015 at 1:41 PM, Naveen Madhire vmadh...@umail.iu.edu
wrote:
Hi,
I want to write junit test cases in scala for testing spark
On Fri, Jul 10, 2015 at 1:41 PM, Naveen Madhire vmadh...@umail.iu.edu
wrote:
I want to write junit test cases in scala for testing spark application.
Is there any guide or link which I can refer.
https://spark.apache.org/docs/latest/programming-guide.html#unit-testing
Typically I create test
Somewhat biased of course, but you can also use spark-testing-base from
spark-packages.org as a basis for your unittests.
On Fri, Jul 10, 2015 at 12:03 PM, Daniel Siegmann
daniel.siegm...@teamaol.com wrote:
On Fri, Jul 10, 2015 at 1:41 PM, Naveen Madhire vmadh...@umail.iu.edu
wrote:
I want
I can +1 Holden's spark-testing-base package.
Burak
On Fri, Jul 10, 2015 at 12:23 PM, Holden Karau hol...@pigscanfly.ca wrote:
Somewhat biased of course, but you can also use spark-testing-base from
spark-packages.org as a basis for your unittests.
On Fri, Jul 10, 2015 at 12:03 PM, Daniel
