[DOC][HOTFIX] updatest to the performance test scripts Closes #616
Project: http://git-wip-us.apache.org/repos/asf/systemml/repo Commit: http://git-wip-us.apache.org/repos/asf/systemml/commit/07bd40a4 Tree: http://git-wip-us.apache.org/repos/asf/systemml/tree/07bd40a4 Diff: http://git-wip-us.apache.org/repos/asf/systemml/diff/07bd40a4 Branch: refs/heads/gh-pages Commit: 07bd40a43bf1bbed2ac9e2ec95fcf7949cc35801 Parents: 16f72cf Author: krishnakalyan3 <[email protected]> Authored: Mon Aug 14 15:18:50 2017 -0700 Committer: Nakul Jindal <[email protected]> Committed: Mon Aug 14 15:18:50 2017 -0700 ---------------------------------------------------------------------- python-performance-test.md | 15 ++++++++++++++- 1 file changed, 14 insertions(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/systemml/blob/07bd40a4/python-performance-test.md ---------------------------------------------------------------------- diff --git a/python-performance-test.md b/python-performance-test.md index 3d29f01..ce36c2d 100644 --- a/python-performance-test.md +++ b/python-performance-test.md @@ -177,7 +177,20 @@ In the example above `--tag` can be a major/minor systemml version and `--auth` Currently we only support time difference between algorithms in different versions. This can be obtained by running the script below `./stats.py --auth client_json.json --exec-mode singlenode --tags 1.0 2.0` -Note: Please pip install `https://github.com/burnash/gspread` to use google docs client. +We pass different `matrix shapes` using `--mat-shape` argument. + +Matrix Shape | Approximate Data Size +--- | --- | +10k_1k|80MB +100k_1k|800MB +1M_1k|8GB +10M_1k|80GB +100M_1k|800GB + +For example the command below runs performance test for all data sizes described above +`run_perftest.py --family binomial clustering multinomial regression1 regression2 stats1 stats2 --mat-shape 10k_1k 100k_1k 1M_1k 10M_1k 100M_1k --master yarn-client --temp-dir hdfs://localhost:9000/user/systemml` + +Note: Please use this command `pip3 install -r requirements.txt` before using the perftest scripts. ## Troubleshooting
