Hello, People of Gaia -- I love Raptor and how it makes it us more data-driven than ever. So I created a tool to aid the data analysis and help you decide if a difference observed between two or more Raptor dataset is significant, given the observed variations in data.
https://github.com/stasm/raptor-compare It's really easy to use: Raptor automatically saves raw measurements in a metrics.ldjson file which you can feed into raptor-compare. It will compute the means and the standard deviations and use that data to help you gauge if the observed difference is "real", or perhaps just an artifact of the random sampling. You can find more information in the project's readme. Let me know if you have any questions! Happy perf testing, -stas PS If you like the tool, help me spread the word: https://twitter.com/stas/status/653630744850468864
_______________________________________________ dev-fxos mailing list [email protected] https://lists.mozilla.org/listinfo/dev-fxos
