Re: How to run PySpark tests?

2016-02-19 Thread Holden Karau
sage in context: >> http://apache-spark-developers-list.1001551.n3.nabble.com/How-to-run-PySpark-tests-tp16357p16362.html >> Sent from the Apache Spark Developers List mailing list archive at >> Nabble.com. >> >>

Re: How to run PySpark tests?

2016-02-18 Thread Holden Karau
; trick! Thanks! > > > > -- > View this message in context: > http://apache-spark-developers-list.1001551.n3.nabble.com/How-to-run-PySpark-tests-tp16357p16362.html > Sent from the Apache Spark Developers List

Re: How to run PySpark tests?

2016-02-18 Thread Jason White
Compiling with `build/mvn -Pyarn -Phadoop-2.4 -Phive -Dhadoop.version=2.4.0 -DskipTests clean package` followed by `python/run-tests` seemed to do the trick! Thanks! -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/How-to-run-PySpark-tests

Re: How to run PySpark tests?

2016-02-18 Thread Holden Karau
.KafkaStreamTests`, with > `java.lang.ClassNotFoundException: > org.apache.spark.streaming.kafka.KafkaTestUtils`. I suspect the same issue > with external libraries. > > I've compiling Spark with `build/mvn -Pyarn -Phadoop-2.4 > -Dhadoop.version=2.4.0 -DskipTests clean package` with no trouble. > > Is there any be

How to run PySpark tests?

2016-02-18 Thread Jason White
: org.apache.spark.streaming.kafka.KafkaTestUtils`. I suspect the same issue with external libraries. I've compiling Spark with `build/mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=2.4.0 -DskipTests clean package` with no trouble. Is there any better documentation somewhere about how to run the PySpark tests? -- View this message