Re: [Wikimedia-l] Update on Discovery search efforts and upcoming releases

[James Salsman]

Sam,

How do you feel about searching recent changes? I saw some estimates that
would take a lot more effort than it would.

Also, is Len Tower still in the Boston area? The more we improve the diff
algorithm, the more edit conflicts we can avoid, and that's certainly worth
the money, time, and effort too.


On Thu, Apr 6, 2017 at 7:07 PM Samuel Klein  wrote:

> Deb, Fantastic.  Really, really great.  And I don't just mean your champion
> footnote selection.
>
> Thanks to you and  Erik for the update!
> SJ
>
> (still dreaming of federated search results from cousin free-knowledge
> projects, and public libraries near you, not just Wikimedia ones :)
>
>
> On Thu, Apr 6, 2017 at 8:11 PM, Erik Bernhardson <
> ebernhard...@wikimedia.org
> > wrote:
>
> > On Thu, Apr 6, 2017 at 4:16 PM, Deborah Tankersley <
> > dtankers...@wikimedia.org> wrote:
> >
> > > Hi Michael,
> > >
> > > It's just searching on Wikipedia for now, as the Structured Data
> project
> > on
> > > Commons is just ramping up.
> > >
> > > Also for some clarity, most of the improvements are not limited to
> > wikipedias, for example the work with ascii folding, and language
> analysis
> > chains applies to all projects for a given language. When we improved how
> > we handled the polish language that was for all projects that use polish
> as
> > their content language. Similarly while the sister project search we are
> > rolling out will only be showing on wikipedias, it is explicitly about
> > including content from the sister projects (wiktionary, wikibooks, etc)
> on
> > the search result page to show users that there is great content
> available
> > from these sister projects.
> >
> > Commons search is hard, and we will get there. We will be working closely
> > with the structured data team to improve searching commons with
> structured
> > data.
> >
> >
> > > Cheers,
> > >
> > > Deb
> > >
> > >
> > > --
> > > deb tankersley
> > > irc: debt
> > > Product Manager, Discovery
> > > Wikimedia Foundation
> > >
> > > On Thu, Apr 6, 2017 at 4:26 PM, Michael Maggs 
> > wrote:
> > >
> > > > Hi
> > > >
> > > > You've mentioned searching on "Wikipedia" there. Did you mean
> > > "Wikimedia",
> > > > or are there still no Commons search improvements as yet?
> > > >
> > > > Michael
> > > >
> > > > Deborah Tankersley 
> > > >> 6 April 2017 at 11:15 pm
> > > >> tl;dr: Search continues to expand functionality by displaying more
> > > >> information on the search results page
> > > >>
> > > >> Ever started searching for something on Wikipedia and
> > wondered—*really*,
> > > >> is
> > > >>
> > > >> that all that there is? Does it feel like you’re somehow playing
> hide
> > > and
> > > >> seek with all the knowledge that’s out there? And...wouldn’t it be
> > great
> > > >> to
> > > >> see articles or categories that are similar to your search query and
> > > maybe
> > > >> some related images or links to other languages in which to read
> that
> > > >> article? Or, maybe you just want to read and contribute to projects
> > > other
> > > >> than Wikipedia but need a jump start with a few short summaries from
> > > >> sister
> > > >> projects.
> > > >> The Discovery Search team has been testing out some really cool new
> > > >> features that will enable some fun and fascinating clicking—down the
> > > >> rabbit
> > > >> hole of Wikipedia.[1] But first, let’s recap what we’ve been doing
> > > >> recently.
> > > >>
> > > >> We've been doing tons of work creating, updating, and finessing the
> > > search
> > > >> back end to enhance search queries. There have been many complex
> > things
> > > >> that have happened, things like: adding ascii-folding and stemming,
> > > >> detecting when a visitor might be typing in a language that is
> > different
> > > >> than the Wikipedia that they are on, switching from tf-idf to BM25,
> > > >> dropping trailing question marks, and updating to ElasticSearch
> > version
> > > 5.
> > > >> [2][3][4][5][6][7] Whew!
> > > >>
> > > >> We have much more planned in the coming months—machine learning with
> > > >> ‘learning to rank’, investigating and deploying new language
> > analyzers,
> > > >> and, after exhaustive analysis, removing quotes within queries by
> > > >> default.[8][9][10][11] We’ll also be working closely with the new
> > > >> Structured Data team in their brand new work on Commons.[12][13]
> > > >>
> > > >> We also want to improve the part that our readers and editors
> > interface
> > > >> with: the search results page! We started brainstorming during the
> > late
> > > >> summer of 2016 on what we could do to make search results better—to
> > > easily
> > > >> find interesting, relevant content and to create a more intuitive
> > > viewing
> > > >> experience.[14] We designed and refined numerous ideas on how to
> > improve
> > > >> the search results page and received lots of good feedback from the
> > > >> community.[15]
> > > >>
> > > >> 

Re: [Wikimedia-l] Update on Discovery search efforts and upcoming releases

[Samuel Klein]

Deb, Fantastic.  Really, really great.  And I don't just mean your champion
footnote selection.

Thanks to you and  Erik for the update!
SJ

(still dreaming of federated search results from cousin free-knowledge
projects, and public libraries near you, not just Wikimedia ones :)


On Thu, Apr 6, 2017 at 8:11 PM, Erik Bernhardson  wrote:

> On Thu, Apr 6, 2017 at 4:16 PM, Deborah Tankersley <
> dtankers...@wikimedia.org> wrote:
>
> > Hi Michael,
> >
> > It's just searching on Wikipedia for now, as the Structured Data project
> on
> > Commons is just ramping up.
> >
> > Also for some clarity, most of the improvements are not limited to
> wikipedias, for example the work with ascii folding, and language analysis
> chains applies to all projects for a given language. When we improved how
> we handled the polish language that was for all projects that use polish as
> their content language. Similarly while the sister project search we are
> rolling out will only be showing on wikipedias, it is explicitly about
> including content from the sister projects (wiktionary, wikibooks, etc) on
> the search result page to show users that there is great content available
> from these sister projects.
>
> Commons search is hard, and we will get there. We will be working closely
> with the structured data team to improve searching commons with structured
> data.
>
>
> > Cheers,
> >
> > Deb
> >
> >
> > --
> > deb tankersley
> > irc: debt
> > Product Manager, Discovery
> > Wikimedia Foundation
> >
> > On Thu, Apr 6, 2017 at 4:26 PM, Michael Maggs 
> wrote:
> >
> > > Hi
> > >
> > > You've mentioned searching on "Wikipedia" there. Did you mean
> > "Wikimedia",
> > > or are there still no Commons search improvements as yet?
> > >
> > > Michael
> > >
> > > Deborah Tankersley 
> > >> 6 April 2017 at 11:15 pm
> > >> tl;dr: Search continues to expand functionality by displaying more
> > >> information on the search results page
> > >>
> > >> Ever started searching for something on Wikipedia and
> wondered—*really*,
> > >> is
> > >>
> > >> that all that there is? Does it feel like you’re somehow playing hide
> > and
> > >> seek with all the knowledge that’s out there? And...wouldn’t it be
> great
> > >> to
> > >> see articles or categories that are similar to your search query and
> > maybe
> > >> some related images or links to other languages in which to read that
> > >> article? Or, maybe you just want to read and contribute to projects
> > other
> > >> than Wikipedia but need a jump start with a few short summaries from
> > >> sister
> > >> projects.
> > >> The Discovery Search team has been testing out some really cool new
> > >> features that will enable some fun and fascinating clicking—down the
> > >> rabbit
> > >> hole of Wikipedia.[1] But first, let’s recap what we’ve been doing
> > >> recently.
> > >>
> > >> We've been doing tons of work creating, updating, and finessing the
> > search
> > >> back end to enhance search queries. There have been many complex
> things
> > >> that have happened, things like: adding ascii-folding and stemming,
> > >> detecting when a visitor might be typing in a language that is
> different
> > >> than the Wikipedia that they are on, switching from tf-idf to BM25,
> > >> dropping trailing question marks, and updating to ElasticSearch
> version
> > 5.
> > >> [2][3][4][5][6][7] Whew!
> > >>
> > >> We have much more planned in the coming months—machine learning with
> > >> ‘learning to rank’, investigating and deploying new language
> analyzers,
> > >> and, after exhaustive analysis, removing quotes within queries by
> > >> default.[8][9][10][11] We’ll also be working closely with the new
> > >> Structured Data team in their brand new work on Commons.[12][13]
> > >>
> > >> We also want to improve the part that our readers and editors
> interface
> > >> with: the search results page! We started brainstorming during the
> late
> > >> summer of 2016 on what we could do to make search results better—to
> > easily
> > >> find interesting, relevant content and to create a more intuitive
> > viewing
> > >> experience.[14] We designed and refined numerous ideas on how to
> improve
> > >> the search results page and received lots of good feedback from the
> > >> community.[15]
> > >>
> > >> Empowered by the feedback, we began testing starting with a display of
> > >> results from the Wikimedia sister projects next to the regular search
> > >> results.[16] The idea for this test was to enable discovery into other
> > >> projects—projects that our visitors might not have known about—by
> > >> displaying interesting results in small snippets. The sidebar display
> of
> > >> the sister projects borrows from a similar feature in use on the
> > Italian,
> > >> Catalan and French Wikipedias. We've run two A/B tests on the sister
> > >> project search results with detailed analysis and, after a bit of
> final
> > >> touches to the 

Re: [Wikimedia-l] Update on Discovery search efforts and upcoming releases

[Erik Bernhardson]

On Thu, Apr 6, 2017 at 4:16 PM, Deborah Tankersley <
dtankers...@wikimedia.org> wrote:

> Hi Michael,
>
> It's just searching on Wikipedia for now, as the Structured Data project on
> Commons is just ramping up.
>
> Also for some clarity, most of the improvements are not limited to
wikipedias, for example the work with ascii folding, and language analysis
chains applies to all projects for a given language. When we improved how
we handled the polish language that was for all projects that use polish as
their content language. Similarly while the sister project search we are
rolling out will only be showing on wikipedias, it is explicitly about
including content from the sister projects (wiktionary, wikibooks, etc) on
the search result page to show users that there is great content available
from these sister projects.

Commons search is hard, and we will get there. We will be working closely
with the structured data team to improve searching commons with structured
data.


> Cheers,
>
> Deb
>
>
> --
> deb tankersley
> irc: debt
> Product Manager, Discovery
> Wikimedia Foundation
>
> On Thu, Apr 6, 2017 at 4:26 PM, Michael Maggs  wrote:
>
> > Hi
> >
> > You've mentioned searching on "Wikipedia" there. Did you mean
> "Wikimedia",
> > or are there still no Commons search improvements as yet?
> >
> > Michael
> >
> > Deborah Tankersley 
> >> 6 April 2017 at 11:15 pm
> >> tl;dr: Search continues to expand functionality by displaying more
> >> information on the search results page
> >>
> >> Ever started searching for something on Wikipedia and wondered—*really*,
> >> is
> >>
> >> that all that there is? Does it feel like you’re somehow playing hide
> and
> >> seek with all the knowledge that’s out there? And...wouldn’t it be great
> >> to
> >> see articles or categories that are similar to your search query and
> maybe
> >> some related images or links to other languages in which to read that
> >> article? Or, maybe you just want to read and contribute to projects
> other
> >> than Wikipedia but need a jump start with a few short summaries from
> >> sister
> >> projects.
> >> The Discovery Search team has been testing out some really cool new
> >> features that will enable some fun and fascinating clicking—down the
> >> rabbit
> >> hole of Wikipedia.[1] But first, let’s recap what we’ve been doing
> >> recently.
> >>
> >> We've been doing tons of work creating, updating, and finessing the
> search
> >> back end to enhance search queries. There have been many complex things
> >> that have happened, things like: adding ascii-folding and stemming,
> >> detecting when a visitor might be typing in a language that is different
> >> than the Wikipedia that they are on, switching from tf-idf to BM25,
> >> dropping trailing question marks, and updating to ElasticSearch version
> 5.
> >> [2][3][4][5][6][7] Whew!
> >>
> >> We have much more planned in the coming months—machine learning with
> >> ‘learning to rank’, investigating and deploying new language analyzers,
> >> and, after exhaustive analysis, removing quotes within queries by
> >> default.[8][9][10][11] We’ll also be working closely with the new
> >> Structured Data team in their brand new work on Commons.[12][13]
> >>
> >> We also want to improve the part that our readers and editors interface
> >> with: the search results page! We started brainstorming during the late
> >> summer of 2016 on what we could do to make search results better—to
> easily
> >> find interesting, relevant content and to create a more intuitive
> viewing
> >> experience.[14] We designed and refined numerous ideas on how to improve
> >> the search results page and received lots of good feedback from the
> >> community.[15]
> >>
> >> Empowered by the feedback, we began testing starting with a display of
> >> results from the Wikimedia sister projects next to the regular search
> >> results.[16] The idea for this test was to enable discovery into other
> >> projects—projects that our visitors might not have known about—by
> >> displaying interesting results in small snippets. The sidebar display of
> >> the sister projects borrows from a similar feature in use on the
> Italian,
> >> Catalan and French Wikipedias. We've run two A/B tests on the sister
> >> project search results with detailed analysis and, after a bit of final
> >> touches to the code, we will release the new functionality into
> production
> >> on all Wikipedias near the end of April 2017.
> >>
> >> Our next A/B test will be to add additional information and related
> >> results
> >> for each search query. This will be in the form of an ‘explore similar’
> >> link that, when someone interacts with the link, an expanded display
> will
> >> appear with related pages, categories and links to the article in other
> >> languages—all of which might lead to further knowledge discovery.[17] We
> >> know that not every search query will return exactly what folks were
> >> 

Re: [Wikimedia-l] Update on Discovery search efforts and upcoming releases

[Deborah Tankersley]

Hi Michael,

It's just searching on Wikipedia for now, as the Structured Data project on
Commons is just ramping up.

Cheers,

Deb


--
deb tankersley
irc: debt
Product Manager, Discovery
Wikimedia Foundation

On Thu, Apr 6, 2017 at 4:26 PM, Michael Maggs  wrote:

> Hi
>
> You've mentioned searching on "Wikipedia" there. Did you mean "Wikimedia",
> or are there still no Commons search improvements as yet?
>
> Michael
>
> Deborah Tankersley 
>> 6 April 2017 at 11:15 pm
>> tl;dr: Search continues to expand functionality by displaying more
>> information on the search results page
>>
>> Ever started searching for something on Wikipedia and wondered—*really*,
>> is
>>
>> that all that there is? Does it feel like you’re somehow playing hide and
>> seek with all the knowledge that’s out there? And...wouldn’t it be great
>> to
>> see articles or categories that are similar to your search query and maybe
>> some related images or links to other languages in which to read that
>> article? Or, maybe you just want to read and contribute to projects other
>> than Wikipedia but need a jump start with a few short summaries from
>> sister
>> projects.
>> The Discovery Search team has been testing out some really cool new
>> features that will enable some fun and fascinating clicking—down the
>> rabbit
>> hole of Wikipedia.[1] But first, let’s recap what we’ve been doing
>> recently.
>>
>> We've been doing tons of work creating, updating, and finessing the search
>> back end to enhance search queries. There have been many complex things
>> that have happened, things like: adding ascii-folding and stemming,
>> detecting when a visitor might be typing in a language that is different
>> than the Wikipedia that they are on, switching from tf-idf to BM25,
>> dropping trailing question marks, and updating to ElasticSearch version 5.
>> [2][3][4][5][6][7] Whew!
>>
>> We have much more planned in the coming months—machine learning with
>> ‘learning to rank’, investigating and deploying new language analyzers,
>> and, after exhaustive analysis, removing quotes within queries by
>> default.[8][9][10][11] We’ll also be working closely with the new
>> Structured Data team in their brand new work on Commons.[12][13]
>>
>> We also want to improve the part that our readers and editors interface
>> with: the search results page! We started brainstorming during the late
>> summer of 2016 on what we could do to make search results better—to easily
>> find interesting, relevant content and to create a more intuitive viewing
>> experience.[14] We designed and refined numerous ideas on how to improve
>> the search results page and received lots of good feedback from the
>> community.[15]
>>
>> Empowered by the feedback, we began testing starting with a display of
>> results from the Wikimedia sister projects next to the regular search
>> results.[16] The idea for this test was to enable discovery into other
>> projects—projects that our visitors might not have known about—by
>> displaying interesting results in small snippets. The sidebar display of
>> the sister projects borrows from a similar feature in use on the Italian,
>> Catalan and French Wikipedias. We've run two A/B tests on the sister
>> project search results with detailed analysis and, after a bit of final
>> touches to the code, we will release the new functionality into production
>> on all Wikipedias near the end of April 2017.
>>
>> Our next A/B test will be to add additional information and related
>> results
>> for each search query. This will be in the form of an ‘explore similar’
>> link that, when someone interacts with the link, an expanded display will
>> appear with related pages, categories and links to the article in other
>> languages—all of which might lead to further knowledge discovery.[17] We
>> know that not every search query will return exactly what folks were
>> looking for, but we feel that adding links to similar, but related
>> information would be helpful and, possibly, super interesting!
>>
>> We also plan on doing a few more A/B tests in the coming year:
>> * Test a new display that will show the pronunciation of a word with its
>> definition and part of speech—all from existing data in Wiktionary.
>> Initially this will be in English only.
>> * Test placing a small image (from the article) next to each search result
>> that is displayed on the page.
>> * Test an additional future using a new auto completion metadata display
>> in
>> the search box that is located on the top right of most pages in
>> Wikipedia,
>> similar to what happens on the Wikipedia.org portal.[18]
>>
>> For the more technical minded, there is a way to test out these new
>> features in your own browser. To display the sister project search
>> results,
>> it will require a bit of URL manipulation; but for the explore similar and
>> Wiktionary widget, you can modify your common.js file to test an early
>> version of the 

Re: [Wikimedia-l] Update on Discovery search efforts and upcoming releases

[Michael Maggs]

Hi

You've mentioned searching on "Wikipedia" there. Did you mean 
"Wikimedia", or are there still no Commons search improvements as yet?


Michael


Deborah Tankersley 
6 April 2017 at 11:15 pm
tl;dr: Search continues to expand functionality by displaying more
information on the search results page

Ever started searching for something on Wikipedia and 
wondered—*really*, is

that all that there is? Does it feel like you’re somehow playing hide and
seek with all the knowledge that’s out there? And...wouldn’t it be 
great to

see articles or categories that are similar to your search query and maybe
some related images or links to other languages in which to read that
article? Or, maybe you just want to read and contribute to projects other
than Wikipedia but need a jump start with a few short summaries from 
sister

projects.
The Discovery Search team has been testing out some really cool new
features that will enable some fun and fascinating clicking—down the 
rabbit
hole of Wikipedia.[1] But first, let’s recap what we’ve been doing 
recently.


We've been doing tons of work creating, updating, and finessing the search
back end to enhance search queries. There have been many complex things
that have happened, things like: adding ascii-folding and stemming,
detecting when a visitor might be typing in a language that is different
than the Wikipedia that they are on, switching from tf-idf to BM25,
dropping trailing question marks, and updating to ElasticSearch version 5.
[2][3][4][5][6][7] Whew!

We have much more planned in the coming months—machine learning with
‘learning to rank’, investigating and deploying new language analyzers,
and, after exhaustive analysis, removing quotes within queries by
default.[8][9][10][11] We’ll also be working closely with the new
Structured Data team in their brand new work on Commons.[12][13]

We also want to improve the part that our readers and editors interface
with: the search results page! We started brainstorming during the late
summer of 2016 on what we could do to make search results better—to easily
find interesting, relevant content and to create a more intuitive viewing
experience.[14] We designed and refined numerous ideas on how to improve
the search results page and received lots of good feedback from the
community.[15]

Empowered by the feedback, we began testing starting with a display of
results from the Wikimedia sister projects next to the regular search
results.[16] The idea for this test was to enable discovery into other
projects—projects that our visitors might not have known about—by
displaying interesting results in small snippets. The sidebar display of
the sister projects borrows from a similar feature in use on the Italian,
Catalan and French Wikipedias. We've run two A/B tests on the sister
project search results with detailed analysis and, after a bit of final
touches to the code, we will release the new functionality into production
on all Wikipedias near the end of April 2017.

Our next A/B test will be to add additional information and related 
results

for each search query. This will be in the form of an ‘explore similar’
link that, when someone interacts with the link, an expanded display will
appear with related pages, categories and links to the article in other
languages—all of which might lead to further knowledge discovery.[17] We
know that not every search query will return exactly what folks were
looking for, but we feel that adding links to similar, but related
information would be helpful and, possibly, super interesting!

We also plan on doing a few more A/B tests in the coming year:
* Test a new display that will show the pronunciation of a word with its
definition and part of speech—all from existing data in Wiktionary.
Initially this will be in English only.
* Test placing a small image (from the article) next to each search result
that is displayed on the page.
* Test an additional future using a new auto completion metadata 
display in
the search box that is located on the top right of most pages in 
Wikipedia,

similar to what happens on the Wikipedia.org portal.[18]

For the more technical minded, there is a way to test out these new
features in your own browser. To display the sister project search 
results,

it will require a bit of URL manipulation; but for the explore similar and
Wiktionary widget, you can modify your common.js file to test an early
version of the features. Detailed information is available on
MediaWiki.org.[19]

Once the testing, analysis and feedback cycle is done for each new 
feature,

we’d like to slowly implement them into production on all Wikipedias
throughout the rest of the year. We’re really hoping that these
enhancements to how search works will further the usefulness of search and
make our readers and editors more productive.

Cheers from the Discovery Search team!

[1] https://xkcd.com/214/
[2] https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/R

[Wikimedia-l] Update on Discovery search efforts and upcoming releases

[Deborah Tankersley]

tl;dr: Search continues to expand functionality by displaying more
information on the search results page

Ever started searching for something on Wikipedia and wondered—*really*, is
that all that there is? Does it feel like you’re somehow playing hide and
seek with all the knowledge that’s out there? And...wouldn’t it be great to
see articles or categories that are similar to your search query and maybe
some related images or links to other languages in which to read that
article? Or, maybe you just want to read and contribute to projects other
than Wikipedia but need a jump start with a few short summaries from sister
projects.
The Discovery Search team has been testing out some really cool new
features that will enable some fun and fascinating clicking—down the rabbit
hole of Wikipedia.[1] But first, let’s recap what we’ve been doing recently.

We've been doing tons of work creating, updating, and finessing the search
back end to enhance search queries. There have been many complex things
that have happened, things like: adding ascii-folding and stemming,
detecting when a visitor might be typing in a language that is different
 than the Wikipedia that they are on, switching from tf-idf to BM25,
dropping trailing question marks, and updating to ElasticSearch version 5.
[2][3][4][5][6][7] Whew!

We have much more planned in the coming months—machine learning with
‘learning to rank’, investigating and deploying new language analyzers,
and, after exhaustive analysis, removing quotes within queries by
default.[8][9][10][11] We’ll also be working closely with the new
Structured Data team in their brand new work on Commons.[12][13]

We also want to improve the part that our readers and editors interface
with: the search results page! We started brainstorming during the late
summer of 2016 on what we could do to make search results better—to easily
find interesting, relevant content and to create a more intuitive viewing
experience.[14] We designed and refined numerous ideas on how to improve
the search results page and received lots of good feedback from the
community.[15]

Empowered by the feedback, we began testing starting with a display of
results from the Wikimedia sister projects next to the regular search
results.[16] The idea for this test was to enable discovery into other
projects—projects that our visitors might not have known about—by
displaying interesting results in small snippets. The sidebar display of
the sister projects borrows from a similar feature in use on the Italian,
Catalan and French Wikipedias. We've run two A/B tests on the sister
project search results with detailed analysis and, after a bit of final
touches to the code, we will release the new functionality into production
on all Wikipedias near the end of April 2017.

Our next A/B test will be to add additional information and related results
for each search query. This will be in the form of an ‘explore similar’
link that, when someone interacts with the link, an expanded display will
appear with related pages, categories and links to the article in other
languages—all of which might lead to further knowledge discovery.[17] We
know that not every search query will return exactly what folks were
looking for, but we feel that adding links to similar, but related
information would be helpful and, possibly, super interesting!

We also plan on doing a few more A/B tests in the coming year:
* Test a new display that will show the pronunciation of a word with its
definition and part of speech—all from existing data in Wiktionary.
Initially this will be in English only.
* Test placing a small image (from the article) next to each search result
that is displayed on the page.
* Test an additional future using a new auto completion metadata display in
the search box that is located on the top right of most pages in Wikipedia,
similar to what happens on the Wikipedia.org portal.[18]

For the more technical minded, there is a way to test out these new
features in your own browser. To display the sister project search results,
it will require a bit of URL manipulation; but for the explore similar and
Wiktionary widget, you can modify your common.js file to test an early
version of the features. Detailed information is available on
MediaWiki.org.[19]

Once the testing, analysis and feedback cycle is done for each new feature,
we’d like to slowly implement them into production on all Wikipedias
throughout the rest of the year. We’re really hoping that these
enhancements to how search works will further the usefulness of search and
make our readers and editors more productive.

Cheers from the Discovery Search team!

[1] https://xkcd.com/214/
[2] https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/R
e-Ordering_Stemming_and_Ascii-Folding_on_English_Wikipedia
[3] https://blog.wikimedia.org/2016/07/27/wikipedia-language-search/
[4] https://en.wikipedia.org/wiki/Tf%E2%80%93idf
[5] https://en.wikipedia.org/wiki/Okapi_BM25
[6]​