Will surely take note for next time. Thanks!
Now that we've got the results from this test, we will soon update the app
to use *only* morelike suggestions, which means you'll be getting twice as
many morelike queries from the app as before. (We'll let you know when
that's released)

On Wed, Jul 29, 2015 at 4:17 PM, Oliver Keyes <oke...@wikimedia.org> wrote:

> This is fantastic work to see!
>
> For future work around this stuff, can I ask that you keep us in the
> loop? When you build a feature like this, users get more things - and
> search gets more queries, some that succeed and some but fail. But for
> this email at the tail-end of the test we wouldn't know this was
> happening, and it has the potential to mess with some of our core
> KPIs.
>
> On 29 July 2015 at 16:01, Dmitry Brant <dbr...@wikimedia.org> wrote:
> > moving to mobile-l, and cc Search & Discovery.
> >
> > ---------- Forwarded message ----------
> > From: Dmitry Brant <dbr...@wikimedia.org>
> > Date: Wed, Jul 29, 2015 at 3:38 PM
> > Subject: "Morelike" suggestions - the results are in!
> > To: Internal communication for WMF Reading team
> > <reading-...@lists.wikimedia.org>
> >
> >
> > Hi all,
> >
> > For the last few weeks, we've had an A/B test in the Android app where we
> > measure user engagement with the "read more" suggestions that we show at
> the
> > bottom of each article. We display three suggestions for further reading,
> > based on either (A) a plain full-text search query based on the title of
> the
> > current article, or (B) a query using the "morelike" feature in
> > CirrusSearch.
> >
> > And the winner is... (perhaps not entirely surprisingly) "morelike"!
> Users
> > who saw suggestions based on "morelike" were over 20% more likely to
> click
> > on one of the suggestions.
> >
> > Here's a quick analysis and chart of the data from the last 10 days:
> >
> >
> https://docs.google.com/spreadsheets/d/1BFsrAcPgexQyNVemmJ3k3IX5rtPvJ_5vdYOyGgS5R6Y/edit?usp=sharing
> >
> >
> > -Dmitry
> >
> >
> >
> > _______________________________________________
> > Wikimedia-search mailing list
> > Wikimedia-search@lists.wikimedia.org
> > https://lists.wikimedia.org/mailman/listinfo/wikimedia-search
> >
>
>
>
> --
> Oliver Keyes
> Research Analyst
> Wikimedia Foundation
>
> _______________________________________________
> Mobile-l mailing list
> mobil...@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/mobile-l
>
_______________________________________________
Wikimedia-search mailing list
Wikimedia-search@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikimedia-search

Reply via email to