On Tue, Feb 15, 2011 at 10:44 AM, Leo <[email protected]> wrote:
> One thing that bugged me a while:
> Why does the bz robots.txt deny any bots? I think having it indexed by google 
> & co would'nt exactly make searching harder.
>
> Leo
Probably because historically you couldn't hide email addresses from
anon (non logged in) users, and well not everyone is a fan of having
their email harvested by bots that obey the robots file.
-Peachey

_______________________________________________
Wikitech-l mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Reply via email to