Thanks Jon, lots of interesting stuff even with such little amount of data.
Are we planning to take this out of beta now?

On Thu, Aug 13, 2015 at 11:35 AM, Jon Katz <[email protected]> wrote:

> Thanks, Baha.
>
> I think the following reinforces your point, but just to clarify, the only
> reason I compared beta to stable was to identify if any of the anomalies we
> saw in beta (decrease in beta pvs, huge spike in 'random' clicks) were
> artifacts of beta adoption or were attributable to normal traffic trends.
>
> On Thu, Aug 13, 2015 at 10:42 AM, Bahodir Mansurov <
> [email protected]> wrote:
>
>> On Thu, 2015-08-13 at 10:07 -0700, Jon Katz wrote:
>> > We need to either increase beta users, a/b test, or test in stable
>> > more (which would also mean a/b testing on a small % of the
>> > population)
>>
>> Thanks, Jon for the write up. I strongly believe this is the way
>> forward for our future experiments. Comparing beta results to stable
>> doesn't make much sense.
>>
>> Baha
>>
>
>
> _______________________________________________
> Mobile-l mailing list
> [email protected]
> https://lists.wikimedia.org/mailman/listinfo/mobile-l
>
>
_______________________________________________
Mobile-l mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mobile-l

Reply via email to