I've spent the past six months or so writing and deploying a replacement on site search system and we've finally decided it was time to blog about it<http://blog.wikimedia.org/2014/01/06/wikimedia-moving-to-elasticsearch/>. I figure this list might find this useful because everything<http://git.wikimedia.org/summary/?r=mediawiki/extensions/CirrusSearch.git>is open source<http://git.wikimedia.org/tree/operations%2Fpuppet.git/production/modules%2Felasticsearch>and public<http://ganglia.wikimedia.org/latest/?c=Elasticsearch%20cluster%20eqiad&m=cpu_report&r=hour&s=by%20name&hc=4&mc=2>. It looks like we're averaging about 3000<http://ganglia.wikimedia.org/latest/?r=day&cs=&ce=&m=es_queries&s=by+name&c=Elasticsearch+cluster+eqiad&h=&host_regex=&max_graphs=0&tab=m&vn=&hide-hf=false&sh=1&z=small&hc=4>queries per second and about 300<http://ganglia.wikimedia.org/latest/?r=day&cs=&ce=&m=es_indexes&s=by+name&c=Elasticsearch+cluster+eqiad&h=&host_regex=&max_graphs=0&tab=m&vn=&hide-hf=false&sh=1&z=small&hc=4>updates per second at the moment which doesn't make us a very big installation but we're excited in our own little way. If you have time please give it a shot here <https://it.wikipedia.org/wiki/Speciale:Ricerca>or here <https://en.wikisource.org/wiki/Special:Search> or here<https://www.mediawiki.org/wiki/Special:Search>or, if you don't mind somewhat uglier results, here <https://www.wikidata.org/wiki/Special:Search>. If you notice anything fishy please let me know or file a bug<https://bugzilla.wikimedia.org/enter_bug.cgi?product=MediaWiki%20extensions&component=CirrusSearch>. We're a pretty small team but we'll get to everything eventually.
Wish me/us luck. Over the next few months we'll be doubling the number of documents indexed and doubling the update rate and ramping up the query rate by about an order of magnitude. Thanks for reading, Nik -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAPmjWd1RM7%2BZdJbUq%2B%2BAnTiz_4Hu1ei9OQ7c31w9%3Dgp248i-6A%40mail.gmail.com. For more options, visit https://groups.google.com/groups/opt_out.
