Re: Name for an A/B testing module?
One more vote for something in the Statistics namespace. We're using Statistics::TTest (https://metacpan.org/module/Statistics::TTest) already for our A/B testing. - Alex On 29 September 2013 11:31, Adrian Howard adri...@quietstars.com wrote: Well done - this will likely mean I can bin my one in development ;-) Statistics::AB? Adrian On 29 September 2013 09:44, Ovid publiustemp-moduleautho...@yahoo.com wrote: Hi all, I've written an A/B testing module for Perl, but I suspect the name Test::AB will annoy people since people expect modules in the Test:: namespace to be about traditional testing tools (exporting test functions or providing a test framework in which said functions are used). This module simply allows you specify the number of visitors and the number of *converted* visitors per experiment and for each experiment, returns a z-score and percentage to help you understand if you should reject the null hypothesis. Needless to say, this doesn't fit into the Boolean yes/no proposition of standard testing in Perl, so namespace suggestions are welcome. Cheers, Ovid -- IT consulting, training, international recruiting http://www.allaroundtheworld.fr/. Buy my book! - http://bit.ly/beginning_perl Live and work overseas - http://www.overseas-exile.com/
Re: Name for an A/B testing module?
On 29 September 2013 17:23, Ovid publiustemp-moduleautho...@yahoo.com wrote: In particular, there's a little known, but hard problem, in A/B testing: http://www.einarsen.no/is-your-ab-testing-effort-just-chasing-statistical-ghosts/ Also see http://xkcd.com/882/ ;) Adrian
Re: Name for an A/B testing module?
On 29 September 2013 17:24, Ovid publiustemp-moduleautho...@yahoo.com wrote: Ooh, we could collaborate! My work is deliberately limited and if you're taking a different approach, that might help. I'm unlikely to have collaboration time free in the immediate future unfortunately. Not getting paid to code ATM ;-/ Adrian
Re: Name for an A/B testing module?
On Sun, Sep 29, 2013 at 02:46:52PM +0200, Leon Timmermans wrote: Sounds like good work. Now I just wish I'd trust people to interpret statistics in a useful manner :-/ This is why Statistics::ChiSquare says things like There's a 90% chance, and a 100% chance, that this data is random. Jon Orwant was wise when he picked that interface, even if it's a bit of a pain for code that uses it. -- David Cantrell | top google result for internet beard fetish club engineer: n. one who, regardless of how much effort he puts in to a job, will never satisfy either the suits or the scientists
Name for an A/B testing module?
Hi all, I've written an A/B testing module for Perl, but I suspect the name Test::AB will annoy people since people expect modules in the Test:: namespace to be about traditional testing tools (exporting test functions or providing a test framework in which said functions are used). This module simply allows you specify the number of visitors and the number of *converted* visitors per experiment and for each experiment, returns a z-score and percentage to help you understand if you should reject the null hypothesis. Needless to say, this doesn't fit into the Boolean yes/no proposition of standard testing in Perl, so namespace suggestions are welcome. Cheers, Ovid -- IT consulting, training, international recruiting http://www.allaroundtheworld.fr/. Buy my book! - http://bit.ly/beginning_perl Live and work overseas - http://www.overseas-exile.com/
Re: Name for an A/B testing module?
Well done - this will likely mean I can bin my one in development ;-) Statistics::AB? Adrian On 29 September 2013 09:44, Ovid publiustemp-moduleautho...@yahoo.com wrote: Hi all, I've written an A/B testing module for Perl, but I suspect the name Test::AB will annoy people since people expect modules in the Test:: namespace to be about traditional testing tools (exporting test functions or providing a test framework in which said functions are used). This module simply allows you specify the number of visitors and the number of *converted* visitors per experiment and for each experiment, returns a z-score and percentage to help you understand if you should reject the null hypothesis. Needless to say, this doesn't fit into the Boolean yes/no proposition of standard testing in Perl, so namespace suggestions are welcome. Cheers, Ovid -- IT consulting, training, international recruiting http://www.allaroundtheworld.fr/. Buy my book! - http://bit.ly/beginning_perl Live and work overseas - http://www.overseas-exile.com/
Re: Name for an A/B testing module?
On Sun, Sep 29, 2013 at 10:44 AM, Ovid publiustemp-moduleautho...@yahoo.com wrote: I've written an A/B testing module for Perl, but I suspect the name Test::AB will annoy people since people expect modules in the Test:: namespace to be about traditional testing tools (exporting test functions or providing a test framework in which said functions are used). This module simply allows you specify the number of visitors and the number of *converted* visitors per experiment and for each experiment, returns a z-score and percentage to help you understand if you should reject the null hypothesis. Needless to say, this doesn't fit into the Boolean yes/no proposition of standard testing in Perl, so namespace suggestions are welcome. Sounds like good work. Now I just wish I'd trust people to interpret statistics in a useful manner :-/ Leon
Re: Name for an A/B testing module?
From: Leon Timmermans faw...@gmail.com Sounds like good work. Now I just wish I'd trust people to interpret statistics in a useful manner :-/ Yes, that's a certainly an issue and I don't know exactly how to deal with it. In particular, there's a little known, but hard problem, in A/B testing: http://www.einarsen.no/is-your-ab-testing-effort-just-chasing-statistical-ghosts/ Cheers, Ovid -- IT consulting, training, international recruiting http://www.allaroundtheworld.fr/. Buy my book! - http://bit.ly/beginning_perl Live and work overseas - http://www.overseas-exile.com/
Re: Name for an A/B testing module?
Ooh, we could collaborate! My work is deliberately limited and if you're taking a different approach, that might help. Cheers, Ovid -- IT consulting, training, international recruiting http://www.allaroundtheworld.fr/. Buy my book! - http://bit.ly/beginning_perl Live and work overseas - http://www.overseas-exile.com/ - Original Message - From: Adrian Howard adri...@quietstars.com To: Ovid publiustemp-moduleautho...@yahoo.com Cc: module-authors@perl.org module-authors@perl.org Sent: Sunday, 29 September 2013, 12:31 Subject: Re: Name for an A/B testing module? Well done - this will likely mean I can bin my one in development ;-) Statistics::AB? Adrian On 29 September 2013 09:44, Ovid publiustemp-moduleautho...@yahoo.com wrote: Hi all, I've written an A/B testing module for Perl, but I suspect the name Test::AB will annoy people since people expect modules in the Test:: namespace to be about traditional testing tools (exporting test functions or providing a test framework in which said functions are used). This module simply allows you specify the number of visitors and the number of *converted* visitors per experiment and for each experiment, returns a z-score and percentage to help you understand if you should reject the null hypothesis. Needless to say, this doesn't fit into the Boolean yes/no proposition of standard testing in Perl, so namespace suggestions are welcome. Cheers, Ovid -- IT consulting, training, international recruiting http://www.allaroundtheworld.fr/. Buy my book! - http://bit.ly/beginning_perl Live and work overseas - http://www.overseas-exile.com/