"Search is central to the Wikipedia experience – both as a way of reaching the website as well as discovering content on Wikipedia."
http://blog.wikimedia.org/2011/10/26/search-and-wikipedia/ Alas, Search is not central for these lists, $ GET http://lists.wikimedia.org/robots.txt # robots.txt for lists.wikimedia.org # # Disabled crawling for several lists 2005-11-26 to # discourage people from complaining about items they # post on public mailing lists being the first Google # search result about them. # # Disabled for all lists 2006-11-03, now that an internal # search has been set up using htdig. # # Note that list archives remain public. # User-agent: * Disallow: /pipermail/ Can they at least take that line about hitdg out. _______________________________________________ Wikitech-l mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikitech-l
