Tim Starling has uploaded a new change for review. https://gerrit.wikimedia.org/r/154234
Change subject: Remove bits.wikimedia.org/robots.txt ...................................................................... Remove bits.wikimedia.org/robots.txt Also robots-private.txt, since this is apparently the only thing that uses it, now that the robots.txt files for the private wikis have been deleted. Requested by Google for much the same reason as IA -- they want to be able to crawl CSS pages. There's no real reason to deny robots in this domain -- it's not like there are expensive things here. Change-Id: I85dcec2a168b9b2d42678d1d9a0e314793c99e21 --- D docroot/bits/robots.txt D robots-private.txt 2 files changed, 0 insertions(+), 7 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/operations/mediawiki-config refs/changes/34/154234/1 diff --git a/docroot/bits/robots.txt b/docroot/bits/robots.txt deleted file mode 120000 index 2843912..0000000 --- a/docroot/bits/robots.txt +++ /dev/null @@ -1 +0,0 @@ -/apache/common/robots-private.txt \ No newline at end of file diff --git a/robots-private.txt b/robots-private.txt deleted file mode 100644 index 1d83080..0000000 --- a/robots-private.txt +++ /dev/null @@ -1,6 +0,0 @@ -# Managed at operations/mediawiki-config/robots-private.txt -User-agent: * -Disallow: / - -User-agent: ia_archiver -Allow: / -- To view, visit https://gerrit.wikimedia.org/r/154234 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I85dcec2a168b9b2d42678d1d9a0e314793c99e21 Gerrit-PatchSet: 1 Gerrit-Project: operations/mediawiki-config Gerrit-Branch: master Gerrit-Owner: Tim Starling <[email protected]> _______________________________________________ MediaWiki-commits mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
