Re: Unit testing: Mocking out Spark classes

2014-10-16 Thread Daniel Siegmann
Mocking these things is difficult; executing your unit tests in a local Spark context is preferred, as recommended in the programming guide . I know this may not technically be a unit test, but it is hopefully close enough. Y

Unit testing: Mocking out Spark classes

2014-10-16 Thread Saket Kumar
Hello all, I am trying to unit test my classes involved my Spark job. I am trying to mock out the Spark classes (like SparkContext and Broadcast) so that I can unit test my classes in isolation. However I have realised that these are classes instead of traits. My first question is why? It is quit