https://bugzilla.wikimedia.org/show_bug.cgi?id=33406

Reedy <[email protected]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
            Summary|Remove robots.txt           |Remove bugzilla robots.txt

--- Comment #3 from Reedy <[email protected]> 2011-12-29 20:07:06 UTC ---
(In reply to comment #1)
> If you know the bug number, it is quicker to use
> http://bugzilla.wikimedia.org/4711 to find the bug.
> 
> Fulltext, freeform search would be great, but a lot can be done with advanced
> search.
> 
> Given the recent struggles here with vandalism and load, though, increasing 
> our
> problems by introducing bots isn't a high priority right now.

True about going directly, if you know, most people wouldn't know that bug 1234
actually is [1]

I'm not sure what the issue is with having Google among others index our
bugzilla instance. It doesn't open us up to any more spam

Looking at [3] it seems we have the default BZ robots.txt installed one

A bit of searching around [2] among others, seems to suggest we'll need to
install the sitemap extension [4]

I also don't think a blanket removal of the robots.txt is a good idea. However,
doing by example [5], and updating to something along those lines seems very
sane. I'm not sure why the default is so limiting. The sitemap extension also
includes an improved robots.txt


We can easily get ops to update the robots.txt, because it's a quick fix, but
might need to find a bit more time to get ops to actually install the
extension, and then presumably possibly a submission to Google webmaster tools


[1] https://bugzilla.wikimedia.org/1234
[2] http://bugzillatips.wordpress.com/2011/05/04/search-bugzilla-using-google/
[3] https://bugzilla.wikimedia.org/robots.txt
[4] http://code.google.com/p/bugzilla-sitemap/
[5] https://bugzilla.mozilla.org/robots.txt

-- 
Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are on the CC list for the bug.

_______________________________________________
Wikibugs-l mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l

Reply via email to