On Mon, Sep 14, 2015 at 1:12 PM, Erik Bernhardson
<[email protected]> wrote:
> Last week we started up a new AB test[1] comparing the existing completion
> suggestions against a new completion suggestion API. This very simply puts
> 1 in 10000 users into the test bucket, and a further 1 in 10000 users into
> the control bucket like so:
> if ( oneIn( 10000 ) ) {
>
> // test bucket
>
> } else if ( oneIn ( 10000 ) ) {
>
> // sample bucket
>
> } else {
>
> return; // rejected
>
> }
This actually puts 1/10,000 of your users in the test bucket, and
0.9999/10,000 in the control bucket.
What you really want is `else if ( oneIn( 9999 ) ) {` for the second clause.
--scott
--
(http://cscott.net)
_______________________________________________
Analytics mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/analytics
