Repository: incubator-systemml Updated Branches: refs/heads/master f275f1a36 -> 9f26b04a1
[SYSTEMML-1226] Add python validation to release process Describe python test execution for release validation. Project: http://git-wip-us.apache.org/repos/asf/incubator-systemml/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-systemml/commit/9f26b04a Tree: http://git-wip-us.apache.org/repos/asf/incubator-systemml/tree/9f26b04a Diff: http://git-wip-us.apache.org/repos/asf/incubator-systemml/diff/9f26b04a Branch: refs/heads/master Commit: 9f26b04a133fe42bc412b159bc4068ae9521d3f5 Parents: f275f1a Author: Deron Eriksson <de...@us.ibm.com> Authored: Wed Feb 1 18:14:10 2017 -0800 Committer: Deron Eriksson <de...@us.ibm.com> Committed: Wed Feb 1 18:14:10 2017 -0800 ---------------------------------------------------------------------- docs/release-process.md | 20 ++++++++++++++++++++ 1 file changed, 20 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-systemml/blob/9f26b04a/docs/release-process.md ---------------------------------------------------------------------- diff --git a/docs/release-process.md b/docs/release-process.md index d734f4f..1cc5c9f 100644 --- a/docs/release-process.md +++ b/docs/release-process.md @@ -184,6 +184,26 @@ sanity check on OS X after building the artifacts manually. hadoop jar SystemML.jar -s "print('hello world');" +## Python Tests + +For Spark 1.*, the Python tests at (`src/main/python/tests`) can be executed in the following manner: + + PYSPARK_PYTHON=python3 pyspark --driver-class-path SystemML.jar test_matrix_agg_fn.py + PYSPARK_PYTHON=python3 pyspark --driver-class-path SystemML.jar test_matrix_binary_op.py + PYSPARK_PYTHON=python3 pyspark --driver-class-path SystemML.jar test_mlcontext.py + PYSPARK_PYTHON=python3 pyspark --driver-class-path SystemML.jar test_mllearn_df.py + PYSPARK_PYTHON=python3 pyspark --driver-class-path SystemML.jar test_mllearn_numpy.py + +For Spark 2.*, pyspark can't be used to run the Python tests, so they can be executed using +spark-submit: + + spark-submit --driver-class-path SystemML.jar test_matrix_agg_fn.py + spark-submit --driver-class-path SystemML.jar test_matrix_binary_op.py + spark-submit --driver-class-path SystemML.jar test_mlcontext.py + spark-submit --driver-class-path SystemML.jar test_mllearn_df.py + spark-submit --driver-class-path SystemML.jar test_mllearn_numpy.py + + ## Check LICENSE and NOTICE Files <a href="#release-candidate-checklist">Up to Checklist</a>