eyala commented on issue #15: Add Spark functionality to DataFu, datafu-spark URL: https://github.com/apache/datafu/pull/15#issuecomment-488644759 I didn't take care of all of Russell's comments, but I had to make some changes in the tests in order for them to pass in all the Spark/Scala versions I included (Spark from 2.1.0 to 2.4.0, Scala 2.10 and 2.11). In order to build and run the tests for all the different versions, you can use the bash script [build_and_test_spark.sh](https://github.com/apache/datafu/blob/spark-tmp/datafu-spark/build_and_test_spark.sh). It takes a little less than an hour to run and test on all the versions.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
