Name for an A/B testing module?
Hi all, I've written an A/B testing module for Perl, but I suspect the name Test::AB will annoy people since people expect modules in the Test:: namespace to be about traditional testing tools (exporting test functions or providing a test framework in which said functions are used). This module simply allows you specify the number of visitors and the number of *converted* visitors per experiment and for each experiment, returns a z-score and percentage to help you understand if you should reject the null hypothesis. Needless to say, this doesn't fit into the Boolean yes/no proposition of standard testing in Perl, so namespace suggestions are welcome. Cheers, Ovid -- IT consulting, training, international recruiting http://www.allaroundtheworld.fr/. Buy my book! - http://bit.ly/beginning_perl Live and work overseas - http://www.overseas-exile.com/
Re: Name for an A/B testing module?
Well done - this will likely mean I can bin my one in development ;-) Statistics::AB? Adrian On 29 September 2013 09:44, Ovid publiustemp-moduleautho...@yahoo.com wrote: Hi all, I've written an A/B testing module for Perl, but I suspect the name Test::AB will annoy people since people expect modules in the Test:: namespace to be about traditional testing tools (exporting test functions or providing a test framework in which said functions are used). This module simply allows you specify the number of visitors and the number of *converted* visitors per experiment and for each experiment, returns a z-score and percentage to help you understand if you should reject the null hypothesis. Needless to say, this doesn't fit into the Boolean yes/no proposition of standard testing in Perl, so namespace suggestions are welcome. Cheers, Ovid -- IT consulting, training, international recruiting http://www.allaroundtheworld.fr/. Buy my book! - http://bit.ly/beginning_perl Live and work overseas - http://www.overseas-exile.com/
Re: Name for an A/B testing module?
On Sun, Sep 29, 2013 at 10:44 AM, Ovid publiustemp-moduleautho...@yahoo.com wrote: I've written an A/B testing module for Perl, but I suspect the name Test::AB will annoy people since people expect modules in the Test:: namespace to be about traditional testing tools (exporting test functions or providing a test framework in which said functions are used). This module simply allows you specify the number of visitors and the number of *converted* visitors per experiment and for each experiment, returns a z-score and percentage to help you understand if you should reject the null hypothesis. Needless to say, this doesn't fit into the Boolean yes/no proposition of standard testing in Perl, so namespace suggestions are welcome. Sounds like good work. Now I just wish I'd trust people to interpret statistics in a useful manner :-/ Leon
Re: Name for an A/B testing module?
From: Leon Timmermans faw...@gmail.com Sounds like good work. Now I just wish I'd trust people to interpret statistics in a useful manner :-/ Yes, that's a certainly an issue and I don't know exactly how to deal with it. In particular, there's a little known, but hard problem, in A/B testing: http://www.einarsen.no/is-your-ab-testing-effort-just-chasing-statistical-ghosts/ Cheers, Ovid -- IT consulting, training, international recruiting http://www.allaroundtheworld.fr/. Buy my book! - http://bit.ly/beginning_perl Live and work overseas - http://www.overseas-exile.com/
Re: Name for an A/B testing module?
Ooh, we could collaborate! My work is deliberately limited and if you're taking a different approach, that might help. Cheers, Ovid -- IT consulting, training, international recruiting http://www.allaroundtheworld.fr/. Buy my book! - http://bit.ly/beginning_perl Live and work overseas - http://www.overseas-exile.com/ - Original Message - From: Adrian Howard adri...@quietstars.com To: Ovid publiustemp-moduleautho...@yahoo.com Cc: module-authors@perl.org module-authors@perl.org Sent: Sunday, 29 September 2013, 12:31 Subject: Re: Name for an A/B testing module? Well done - this will likely mean I can bin my one in development ;-) Statistics::AB? Adrian On 29 September 2013 09:44, Ovid publiustemp-moduleautho...@yahoo.com wrote: Hi all, I've written an A/B testing module for Perl, but I suspect the name Test::AB will annoy people since people expect modules in the Test:: namespace to be about traditional testing tools (exporting test functions or providing a test framework in which said functions are used). This module simply allows you specify the number of visitors and the number of *converted* visitors per experiment and for each experiment, returns a z-score and percentage to help you understand if you should reject the null hypothesis. Needless to say, this doesn't fit into the Boolean yes/no proposition of standard testing in Perl, so namespace suggestions are welcome. Cheers, Ovid -- IT consulting, training, international recruiting http://www.allaroundtheworld.fr/. Buy my book! - http://bit.ly/beginning_perl Live and work overseas - http://www.overseas-exile.com/
