[SYSTEMML-1226] Add python validation to release process Describe python test execution for release validation.
Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-systemml/commit/b9d878c4 Tree: http://git-wip-us.apache.org/repos/asf/incubator-systemml/tree/b9d878c4 Diff: http://git-wip-us.apache.org/repos/asf/incubator-systemml/diff/b9d878c4 Branch: refs/heads/gh-pages Commit: b9d878c47329f4d26e173ed8b046a523c6e19d5f Parents: fe26aab Author: Deron Eriksson <de...@us.ibm.com> Authored: Wed Feb 1 18:14:10 2017 -0800 Committer: Deron Eriksson <de...@us.ibm.com> Committed: Wed Feb 1 18:14:10 2017 -0800 ---------------------------------------------------------------------- release-process.md | 20 ++++++++++++++++++++ 1 file changed, 20 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-systemml/blob/b9d878c4/release-process.md ---------------------------------------------------------------------- diff --git a/release-process.md b/release-process.md index d734f4f..1cc5c9f 100644 --- a/release-process.md +++ b/release-process.md @@ -184,6 +184,26 @@ sanity check on OS X after building the artifacts manually. hadoop jar SystemML.jar -s "print('hello world');" +## Python Tests + +For Spark 1.*, the Python tests at (`src/main/python/tests`) can be executed in the following manner: + + PYSPARK_PYTHON=python3 pyspark --driver-class-path SystemML.jar test_matrix_agg_fn.py + PYSPARK_PYTHON=python3 pyspark --driver-class-path SystemML.jar test_matrix_binary_op.py + PYSPARK_PYTHON=python3 pyspark --driver-class-path SystemML.jar test_mlcontext.py + PYSPARK_PYTHON=python3 pyspark --driver-class-path SystemML.jar test_mllearn_df.py + PYSPARK_PYTHON=python3 pyspark --driver-class-path SystemML.jar test_mllearn_numpy.py + +For Spark 2.*, pyspark can't be used to run the Python tests, so they can be executed using +spark-submit: + + spark-submit --driver-class-path SystemML.jar test_matrix_agg_fn.py + spark-submit --driver-class-path SystemML.jar test_matrix_binary_op.py + spark-submit --driver-class-path SystemML.jar test_mlcontext.py + spark-submit --driver-class-path SystemML.jar test_mllearn_df.py + spark-submit --driver-class-path SystemML.jar test_mllearn_numpy.py + + ## Check LICENSE and NOTICE Files <a href="#release-candidate-checklist">Up to Checklist</a>
