Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/11194 )
Change subject: IMPALA-7426: Use Mann-Whitney U to compare benchmarks ...................................................................... IMPALA-7426: Use Mann-Whitney U to compare benchmarks The Mann-Whitney test can be used to compare samples taken from non-normal distributions, and so can more accurately reflect performance changes than a T-test. This patch does not remove t-tests from the benchmark reporting, it just supplements them by including the Mann-Whitney test result as well. Change-Id: I8d6631ebeba1422b832def5cd68537624f672fa0 Reviewed-on: http://gerrit.cloudera.org:8080/11194 Reviewed-by: Jim Apple <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> --- M tests/benchmark/report_benchmark_results.py M tests/util/calculation_util.py 2 files changed, 85 insertions(+), 37 deletions(-) Approvals: Jim Apple: Looks good to me, approved Impala Public Jenkins: Verified -- To view, visit http://gerrit.cloudera.org:8080/11194 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I8d6631ebeba1422b832def5cd68537624f672fa0 Gerrit-Change-Number: 11194 Gerrit-PatchSet: 6 Gerrit-Owner: Jim Apple <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Jim Apple <[email protected]> Gerrit-Reviewer: Philip Zeyliger <[email protected]>
