This is fantastic work to see! For future work around this stuff, can I ask that you keep us in the loop? When you build a feature like this, users get more things - and search gets more queries, some that succeed and some but fail. But for this email at the tail-end of the test we wouldn't know this was happening, and it has the potential to mess with some of our core KPIs.
On 29 July 2015 at 16:01, Dmitry Brant <[email protected]> wrote: > moving to mobile-l, and cc Search & Discovery. > > ---------- Forwarded message ---------- > From: Dmitry Brant <[email protected]> > Date: Wed, Jul 29, 2015 at 3:38 PM > Subject: "Morelike" suggestions - the results are in! > To: Internal communication for WMF Reading team > <[email protected]> > > > Hi all, > > For the last few weeks, we've had an A/B test in the Android app where we > measure user engagement with the "read more" suggestions that we show at the > bottom of each article. We display three suggestions for further reading, > based on either (A) a plain full-text search query based on the title of the > current article, or (B) a query using the "morelike" feature in > CirrusSearch. > > And the winner is... (perhaps not entirely surprisingly) "morelike"! Users > who saw suggestions based on "morelike" were over 20% more likely to click > on one of the suggestions. > > Here's a quick analysis and chart of the data from the last 10 days: > > https://docs.google.com/spreadsheets/d/1BFsrAcPgexQyNVemmJ3k3IX5rtPvJ_5vdYOyGgS5R6Y/edit?usp=sharing > > > -Dmitry > > > > _______________________________________________ > Wikimedia-search mailing list > [email protected] > https://lists.wikimedia.org/mailman/listinfo/wikimedia-search > -- Oliver Keyes Research Analyst Wikimedia Foundation _______________________________________________ Mobile-l mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/mobile-l
