This is fantastic work to see! For future work around this stuff, can I ask that you keep us in the loop? When you build a feature like this, users get more things - and search gets more queries, some that succeed and some but fail. But for this email at the tail-end of the test we wouldn't know this was happening, and it has the potential to mess with some of our core KPIs.
On 29 July 2015 at 16:01, Dmitry Brant <dbr...@wikimedia.org> wrote: > moving to mobile-l, and cc Search & Discovery. > > ---------- Forwarded message ---------- > From: Dmitry Brant <dbr...@wikimedia.org> > Date: Wed, Jul 29, 2015 at 3:38 PM > Subject: "Morelike" suggestions - the results are in! > To: Internal communication for WMF Reading team > <reading-...@lists.wikimedia.org> > > > Hi all, > > For the last few weeks, we've had an A/B test in the Android app where we > measure user engagement with the "read more" suggestions that we show at the > bottom of each article. We display three suggestions for further reading, > based on either (A) a plain full-text search query based on the title of the > current article, or (B) a query using the "morelike" feature in > CirrusSearch. > > And the winner is... (perhaps not entirely surprisingly) "morelike"! Users > who saw suggestions based on "morelike" were over 20% more likely to click > on one of the suggestions. > > Here's a quick analysis and chart of the data from the last 10 days: > > https://docs.google.com/spreadsheets/d/1BFsrAcPgexQyNVemmJ3k3IX5rtPvJ_5vdYOyGgS5R6Y/edit?usp=sharing > > > -Dmitry > > > > _______________________________________________ > Wikimedia-search mailing list > Wikimediafirstname.lastname@example.org > https://lists.wikimedia.org/mailman/listinfo/wikimedia-search > -- Oliver Keyes Research Analyst Wikimedia Foundation _______________________________________________ Wikimedia-search mailing list Wikimediaemail@example.com https://lists.wikimedia.org/mailman/listinfo/wikimedia-search