I was just about to suggest this and, indeed, say that Oliver had done some similar work before :-)
If you look at (# of users who have opted out) / (# of users who have set preferences) you may get a more meaningful result - you'll be screening out all the ones who don't know how to or aren't comfortable with changing settings regardless of how badly it irritates them. Andrew. On 9 June 2014 21:36, Oliver Keyes <[email protected]> wrote: > Re user counts; we have, I think, 1 editor who has 1M+ edits. I imagine we > don't have many with 100K edits. How big are those user groups? It's useful > to know that power users are more likely to opt out, great, but if you only > have 30 users in your definition of 'power users' it's going to be thrown > off very easily. > > My big worry would be that finding this out only tells you that either (1) > only power users have a problem or (2) only power users can find the > off-switch. Comparing with other features that also feature an off-switch > would allow you to eliminate this as an independent variable. > > > On 9 June 2014 11:55, Gergo Tisza <[email protected]> wrote: >> >> On Mon, Jun 9, 2014 at 11:20 AM, Aaron Halfaker <[email protected]> >> wrote: >>> >>> Also, opt-out rates tend to be low no matter how obvious and desired they >>> are. If the goal of this analysis is to find out if opt-out rates are high >>> (or low), then I'd recommend comparing them with opt-out rates for another >>> feature. >> >> >> One thing I did was to compare opt-out rates with other wikis where we >> have received fewer complaints (fr, es), and enwiki optouts seem to be in >> the same range. Do you think that is a useful indicator, or comparing optout >> rates for wikis with a different userbase size is not particularly useful? >> >> _______________________________________________ >> Analytics mailing list >> [email protected] >> https://lists.wikimedia.org/mailman/listinfo/analytics >> > > > > -- > Oliver Keyes > Research Analyst > Wikimedia Foundation > > _______________________________________________ > Analytics mailing list > [email protected] > https://lists.wikimedia.org/mailman/listinfo/analytics > -- - Andrew Gray [email protected] _______________________________________________ Analytics mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/analytics
